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Editorial Comment 


Dressel said recently, “Everything is more complex than it seems.” I add anothe 
sprichwort—“Everything worth saying has already been said—by someone else.” In 1 


sponse to the editor’s invitation, I undertook to describe my motivation to transpos| 


counseling techniques and points of view to other parts of personnel programs. This is 
done, in terms of my own sprichwort, as a commentary upon Dressel’s basic theme, that 
“counseling psychology should become the basic discipline from which all other top 
level student personnel workers are drawn.” 


Recently we have seen encouraging improvement in more sophisticated designs of 
counseling research, and in more critical attention to the strategic role of personality 
theory. With counseling thus developing from a much firmer base, one feels secure in 
exploring the uses of counseling techniques and emphases to reform other relationship 
with students. 


In my own shift from counseling to administration, I carried along counseling e& 
periences. But I had to supplement my counseling background with new experiences; 
philosophy of education; administrative theory; concepts of human nature found in the 
humanities; some aspects of personality theory; and relevant gleanings from contempor- 
ary social psychology. With these supplements a counselor can appraise his contribu. 
tions to the development of students as opposed to an over-the-counter service relation- 
ship of little educational significance. 


Counseling can thus contribute to education in at least three dimensions: a unique 
perspective with the student the central strategy of services; new expectations in which 
the student’s fullest possible development sums up these expectations; and ways of using 
interpersonal relationships to realize these expectations. 


I identify five areas in which counseling presently contributes uniquely to othe 
personnel services: (1) discipline, with its disgraceful history of repression, can he 
changed from retributive punishment for the breaking of rules into rehabilitation; (2) 
changes in self-concepts for student leaders often inhibited from seeking needed coun 
seling because of their perceived status roles; (3) student leaders can use counseling 
techniques in selection of student appointees, not ‘on the basis of popularity, but in 
terms of developmental needs of the appointee; (4) foreign students can be “related 
to,” not by governmental processing on compliance with regulations, but as human 
beings accommodating themselves to new cultural demands, while still striving for con 
tinuity of integrity; (5) students, in group relationships, can learn counseling methods 
of dealing with disparate and conflicting value orientations about civil liberties, discrim- 
inations and other forms of interpersonal conflicts. 


One can use such transposing experiences as testing ground for accepted canons 
and conventions originating in the counseling interview. For example, one learns new, 
and perplexing, dimensions of the concept of confidentiality (see Stroup’s recent incisive 
analysis, Fall issue 1957, pp. 248-250). One also learns to re-examine tribal dogma 
about voluntary presentation of a client as a sine qua non for counseling relationship. 
And beyond the restricted universe of the personal interview, one learns also to re-open 
the issue of fixed versus fluid goals and expectations of counseling relationships. 


E. G. Williamson 


Note: Stroup’s article cited above is commented up 
on by Leona Tyler, Letters to Editor, this issue. Ed. 

















_ 


Abou 
William 
think al 
in coun: 
found c 
confron' 
studies 
able pre 
Strengtl 
Rating : 
ing. Bu 
what c! 
tions? 
length. 
decided 
of strat 

Let nr 
tion the 
clinics | 
assiduot 
rated a: 
improve 
things 
intervie 
counsel 
distinct: 
troduce 

This | 
posium o 
ing” at ¢ 
sonnel A 
sonnel | 
Ohio, Aj 
as a sy! 
when ex: 
They are 
A seconc 
this issue 
“Counsel 
The rem 
“The Ec 
©. Gib 
ing,” wi 


Journal.- 





In we 
MSpose 
This is 
e, that 
ier top 


igns of 
onality 


ure in 


ng e& 
ences; 


>mpor- 
atribu. 
lation- 


inique 
which 


n be 
; (2) 


seling 
put in 
elated 
juman 
r COM 


thods 


anons 


cisive 
ogma 
ship. 
open 


l 








Journal of Counseling Psychology 
Vol. 4, No. 4, 1957 


Methodology in Counseling Evaluation 


Desmond S. Cartwright’ 
University of Chicago 


The Present State of Affairs 


About a year ago, Donald W. Fiske, 
William L. Kirtner, and I sat down to 
think about the prediction of performance 
in counseling and psychotherapy. We soon 
found ourselves at a dead end. We were 
confronted with a handful of prognostic 
studies from which we might draw toler- 
able predictors. Of them all, Barron’s Ego- 
Strength Scale (2) and Klopfer’s Prognostic 
Rating Scale (12) seemed the most promis- 
ing. But what should our targets be? At 
what criterion would we aim our predic- 
tions? We considered the situation at 
length. Finally, we gave up searching and 
decided that we had to face a major task 
of strategic reorganization. 

Let me give you a picture of the situa- 
tion that confronted us. For many years 
clinics and hospitals the world over had 
assiduously gathered percentages of cases 
rated as improved, slightly improved, un- 
improved, or deteriorated. Then three 
things happened: electrical recording of 
interviews was made possible; clinical and 
counseling psychology grew rapidly into 
distinctive disciplines; and Carl Rogers in- 
troduced client-centered therapy with its 


1This is one of four papers presented in a sym- 
posium on “Research in Selected Areas of Counsel- 
ing” at the meetings of the American College Per- 
sonnel Association (Division of the American Per- 
sonnel and Guidance Association), Cleveland, 
Ohio, April 17, 1957. Although presented orally 
as a symposium, they did not “hang together” 
when examined editorially as a written symposium. 
They are therefore presented as separate papers. 
A second paper from the symposium reported in 
this issue of the Journal is that by Bernard Stotsky, 
“Counseling Research in the Hospital Setting.” 
The remaining two papers, by Dugald Arbuckle, 
“The Education of the School Counselor,” and 
C. Gilbert Wrenn, “The Self Concept in Counsel- 
ing,” will appear in the Spring issue of this 
Journal.—Ed. 


emphasis on continuous and ramifying re- 
search (15). 

Then began a stream of studies of 
changes in behavior over successive inter- 
views, and in test behavior before, dur- 
ing, and after therapy. Among the earli- 
est studies of recorded interviews was 
Snyder’s important work (18). He found, 
for example, that statements of problems 
decreased over therapy while understand- 
ing and insight increased. His method 
was that of content analysis, which in- 
volves splitting up the protocol into unit 
statements and categorizing each unit by 
one of a series of predefined categories. 
Then, percentages of each category are 
computed for each interview and plotted 
over the whole sequence of interviews. 
This method, with variants and refine- 
ments of course, has since been very wide- 
ly used. Auld and Murray (1) have re- 
cently presented a valuable survey of such 
studies, mostly with different sets of cate- 
gories. Here are just a few of the vari- 
ables that have been looked at in this way: 
evaluation of self and others (16), behavior 
variability (17), discomfort versus relief 
(7). The beauty of interview material is 
that it provides frozen behavior. And an 
investigator may work with this material 
at leisure and in a virtually unlimited num- 
ber of ways. 

Let us now take a look at studies that 
have employed test behavior as their data- 
source. We find a truly bewildering array: 
well-kniown personality questionnaires like 
the Hildreth, Bell, and MMPI (13), special- 
ly constructed rating scale (19), projective 
tests like the Rorschach and Thematic Ap- 
perception Test (8, 11), Q-sorts with vari- 
ous samples of statements by which the 
client describes himself (4), tests of re- 
action to stress (20). And here are just a 
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few of the variables that have been looked 
at by means of tests: emotional maturity 
(14), manifest anxiety (9), quality of real- 
ity orientation (11), degree of comfort in 
interpersonal realtions (8), degree of dis- 
crepancy between self and ideal concepts 
(4), organismic recovery speed following 
frustration (20). 


Questions to Which We Need Answers 


Now, as you may imagine, there are lit- 
erally hundreds of variables that have 
been measured in one way or another (8, 
5). The question arises: do all these vari- 
ables change together? That is, if the cli- 
ent changes a great deal on one variable, 
will he also change a great deal on all 
the others? If that were the case, if all 
possible change variables were highly in- 
tercorrelated, there would be no problem 
in choosing a variable as target for a pre- 
diction study. Any one would do. 

But, suppose that a client changes a 
great deal on one variable, a little on an- 
other, none at all on another and changes 
for the worse, or deteriorates, on yet an- 
other variable. Suppose, in short, that all 
or most of the hundreds of variables so 
far studied were essentially uncorrelated. 
Which variables would you choose then 
as your target for prediction purposes? 


Do Factor Studies Help? 


As a matter of fact, two studies have 
wecently appeared which shed some light 
‘on the situation. The first was that of 
Gibson, Snyder, and Ray (10) who inter- 
correlated 20 measures of change. They 
then did a factor analysis of the correla- 
tions and found 7 factors; that is, 7 groups 
of variables changing together. They con- 
sidered only the first three factors worthy 
of interpretation. The first factor was made 
up of ratings and scores based upon the 
interview material. The second factor was 
made up of scores from the Rorschach. The 
third factor was made up chiefly of MMPI 
scales, but also included the client’s own 
rating of his progress. The authors inter- 
preted these factors to be associated chief- 
ly with the instruments of measurement. 
‘They also suggested that the third factor 


Cartwright 


represented measurement of change from 
the client’s frame of reference. 

The second study, by Cartwright and 
Roth (6), also used factor analysis. They 
were concerned to examine Rogers’ hy- 
pothesis that different observers have dif- 
ferent perceptual vantage points and hence 
give different evaluations of personality 
and personality change. These authors 
found just 2 factors in a matrix of 10 
change variables: the client’s view of 
change, and the therapist’s view of change, 
These two groups of variables were com- 
pletely independent. Both factors ran over 
several instruments, however, and the ther- 
apist factor also included estimates from 
diagnosticians and lay observers. 

It certainly seems, then, that when vari- 
ables are measured from the client’s frame 
of reference, as Gibson, Snyder, and Ray 
put it, those variables show changes which 
are quite unrelated to variables measured 
from other frames of reference. In another 
matrix analyzed by Cartwright and Roth, 
a matrix of post-therapy level scores, both 
the client and the therapist showed up on 
separate factors. There was a third factor, 
however, which included variables from 
client, therapist, and diagnostician. This 
factor was interpreted as client response 
to others. 

Now the results of these studies do shed 
some light on the situation. They show, 
first, that change variables tend to cluster 
into groups. Second, they show that these 
groups may derive their membership either 
from a common instrument of measure- 
ment, or from a common class of observers, 
or from something else. The problem of 
choosing a target for prediction, then, is 
at least made simpler by the. knowledge 
that not every variable is uncorrelated with 
every other variable. The problem is sharp- 
ened, however, into choices between ma- 
jor categories: Which instrument? Which 
class of observers? Is the interview more 
valid or worthwhile than the Rorschach? 
Is the client’s frame of reference more 
important than that of the therapist, the 
diagnostician, or the client’s friends and 
relations? Or should we consider these 
classes of observers, these frames of ref- 
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erence, as something like different lenses 
through which we have to peer if we want 
to get at what is “really there.” 


Our Plan of Attack 


Fiske, Kirtner, and I could not answer 
these questions. We felt that the previ- 
ous studies were based on too few sub- 
jects and used too small a sample of vari- 
ables to permit satisfactory answers. So, 
we decided to postpone our prediction 
study for about five years, and we set 
about asking our questions experimentally. 

We asked: Are there really “instrument 
factors?” Are there really “observer fac- 
tors?” And if there are, what substantive 
change factors are there also? 

By substantive we meant not limited to 
one particular instrument or one particu- 
lar class of observers. Our original aim 
after all was to predict performance in 
counseling and psychotherapy. We did not 
wish to end up saying such things as “we 
can predict how clients will change in the 
way they estimate their own adjustment, 
but we cannot predict how therapists will 
change in the way they estimate their cli- 
ents’ adjustment.” Nor did we want to 
end up saying such things as “we can pre- 
dict changes in depressive behavior as 
measured by the MMPI, but unfortunately 
we cannot predict changes in depressive 
behavior as measured by diagnostic rat- 
ings of the Rorschach.” After all, we said, 
if depressive behavior is a discriminable 
kind of behavior, then either it is being 
measured by only one of the two tests and 
not the other, or it is a loose composite 
of two discriminable kinds of behavior, one 
picked up by the: MMPI, the other picked 
up by the Rorschach. And, if the two are 
uncorrelated, then lumping them together 
into one composite called depressive be- 
havior is confusing rather than clarifying. 

What we wanted to be able to say was 
something like this: “We can predict 
changes in adequacy of personal decision- 
making.” This sounds simple enough. In- 
deed it has fewer qualifications of the 
kind “from so-and-so’s frame of reference,” 
or “as measured by such-and-such.” Also, 
itis more restricted in range of reference 
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than adjustment or depressive behavior. 
But it has more power, more substance 
for psychological craftsmanship. Given 
only that the definition or description of 
the target is held constant, we should be 
able to say “such-and-such a predictor pre- 
dicts that target, no matter who observes 
it or how you measure it.” 

So the three of us planned a study in 
which we would measure changes in a 
large number of variables on a large num- 
ber of subjects. We combed the literature 
reporting changes over therapy and we 
mulled over the resulting mass of variables. 
We did a sort of armchair group-factor 
analysis, and arrived at a set of 14 dis- 
criminable kinds of behavior. We then 
set about describing those kinds of be- 
havior as fully as possible. And for each 
kind of behavior we constructed a set of 
vignettes, verbal pictures of people per- 
forming that kind of behavior with dif- 
ferent degrees of adequacy. Such a set 
of vignettes then constituted the anchors 
for a rating scale. We called this a core 
scale. Then we reworded each vignette 
in such a way that it would be immediate- 
ly understandable by a particular observer: 
client, therapist, interview judge, or diag- 
nostician. Thus, all observers will have 
essentially the same scales by which to 
describe the clients’ behavior. 

We also included in our battery several 
widely used instruments such as the MMPI, 
TAT, Butler-Haigh Q-sort, California E- 
scale, and others. These instruments will 
yield a wide variety of measures that have 
previously been found to show changes 
over therapy. Indeed, a good part of the 
total mass of change variables that initially 
confronted us came precisely from these 
instruments. We shall be able to see di- 
rectly the relations between changes on 
these more or less standard instruments 
and changes on our behavioral rating 
scales. 

In this way, we have set the stage for 
different classes of observers and different 
instruments to agree or disagree about 
precisely the same kinds of behavior. Any 
class of observers or any instrument that 
simply agrees with itself over several dif- 
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ferent kinds of behavior will clearly yield 
a pure observer factor or instrument fac- 
tor. Where several classes of observers 
and several instruments agree together 
about just one kind of behavior, we shall 
have a substantive factor. 


What We Expect 


We hope to come out with a good num- 
ber of substantive factors. We should then 
have a beginning understanding of the pri- 
mary factors of personality change. We do 
not expect to solve everything at once. On 
the contrary, we know from previous fac- 
torial work that it will take prolonged in- 
terpretation, revision and refinement of 
measures, and replicated studies before we 
arrive at a full and satisfactory under- 
standing of the primary factors. More- 
over, the factors we discover will remain 
restricted to our population of clients un- 
til replications on other populations in 
other centers and clinics permit wider gen- 
eralization. 

I have emphasized personality change 
rather than outcome. This stems from our 
consideration that a measure of outcome, 
or status of the person at the end of thera- 
py, is relatively worthless without a meas- 
ure of his intake status. We believe that 
the critical dependent variable for evalua- 
tion studies must be a change variable. 

We think that at the present stage of the 
science of evaluation, it is of major stra- 
tegic importance to analyze that global de- 
pendent variable called personality change 
into its discriminable, independent com- 
ponents if such exist. And we think they 
do exist. A good student with no study 
problems who experiences difficulty in in- 
terpersonal relations is not likely to im- 
prove his work efficiency very much as a 
result of counseling. He is very efficient 
to start with. But he is likely to improve 
his interpersonal skills, for that is where 
he needs to change and can change for 
the better. And if he does come out with 
greater ease and facility in his relation- 
ships, who knows: he might even be less 
efficient (or less compulsively efficient) in 
his work. And “successful counseling” for 
him would likely mean very different 
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changes in behavior from what it would 
mean for a student who started with noth- 
ing but study problems. 

As I said earlier, our factors would initi- 
ally be restricted to our own client popv- 
lation. We hope therefore that other in- 
vestigators will consider our factorial re- 
sults and study their own populations to 
see if invariant factors emerge. Factors 
found to be invariant across several popu- 
lations and several methods of counseling 
and therapy would constitute veritable 
strongholds for the strategy of our science, 
Indeed, we think that this is the only way 
to arrive at a stable, generally acceptable 
set of dependent variables for use in any 
kind of evaluation study. 


Received April 20, 1957. 
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When Shall We Use Our Heads 
Instead of the Formula? 


Paul E. Meehl’ 
University of Minnesota 


My title question, “When should we use 
our heads instead of the formula?” is not 
rhetorical. I am sincerely asking what I see 
as an important question. I find the two 
extreme answers to this question, namely, 
“Always” and “Never,” equally unaccept- 
able. But to formulate a satisfactory answer 
upon the present evidence seems extra- 
ordinarily difficult. 

I put the question in the practical clini- 
cal context. This is where Sarbin put it in 
his pioneering study 14 years ago, and this 
is where it belongs. Some critics of my 
book (5) have repudiated the whole ques- 
tion by saying that, always and necessarily, 
we use both our heads and the formula. 
No, we do not. In research, we use both; 
the best clinical research involves a shut- 
tling back and forth between clever, crea- 
tive speculation and subsequent statistical 
testing of empirical derivations therefrom. 
So far as I am aware, nobody has ever 
denied this. Even the arch-actuary George 
Lundberg approved of the clinician as hy- 
pothesis-maker. In research one cannot de- 
sign experiments or concoct theories with- 
out using his head, and he cannot test them 
rigorously without using a formula. This 
is so obvious that I am surprised to find 
that people will waste time in discussing 
it. The clinical-statistical issue can hardly 
be stated so as to make sense in the research 
context, and I should have thought it clear 
that a meaningful issue can be raised only 
in the context of daily clinical activity. 

1Presented at the 1956 Convention of the Amer- 
ican Psychological Association, Chicago. This will 
also appear in a forthcoming book: Herbert Feigl, 
Michael Scriven, and Grover Maxwell (Eds.), 
Concepts, Theories, and the Mind-Body Problem, 
Vol. II of Minnesota Studies in the Philosophy of 
Science. Minneapolis, Minnesota: University of 
Minnesota Press, 1958. 


In the clinical context, on the other hand, 
the question is sensible and of great practi. 
cal importance. Here we have the working 
clinician or administrator, faced with the 
necessity to make a decision at this moment 


in time, regarding this particular patient | pose 
He knows that his evidence is inadequate. | i 


He can think of several research projects 
which, had they been done already, would 
be helpful to him in deciding the present 
case. If he is research-oriented he may even 
make a note of these research ideas and 
later carry them out or persuade someone 
else to do so. But none of that helps him 
now. He is in a sort of Kierkegaardian exis- 
tential predicament, because he has to act, 
As Joe Zubin kept repeating when I last 
tangled with him on this subject, “Every 
clinical decision is a Willensakt.” And s0 
it is; but the question remains, how do we 
make our Willensakts as rational as pos 
sible upon limited information? What clin 
ician X knows today and what he could 
find out by research in ten years are two 
very different things. 

The question, “When shall we use our 
heads instead of the formula?” presupposes 
that we are about to make a clinical de 
cision at a given point in time, and must 
base it upon what is known to us at that 
moment. In that context, the question 
makes perfectly good sense. It is silly to 
answer it by saying amicably, “We use both 
methods, they go hand in hand.” If the 
formula and your head invariably yield 
the same predictions about individuals, you 
should quit using the more costly one be 
cause it is not adding anything. If they 
don’t always yield the same prediction- 
and they clearly don’t, as a matter of em- 
pirical fact—then you obviously can’t “use 
both,” because you cannot predict in op 
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ite ways for the same case. If one says 
then, “Well, by ‘using both, I mean that 
we follow the formula except on special 
occasions,” the problem becomes how to 
identify the proper sub-set of occasions. 
And this of course amounts to the very 
question I am putting. For example, does 
the formula tell us “Here, use your heads,” 
or do we rely on our heads to tell us this, 
thus countermanding the formula? 


The Pragmatic Decision Problem Stated 
Most decisions in current practice do not 


pose this problem because no formula ex- 
ists. Sometimes there is no formula because 
the prediction problem is too open-ended, 
as in dream analysis; sometimes the very 
categorizing of the raw observations in- 
volves Gestalted stimulus equivalences for 
which the laws are unknown, and hence 
cannot be mathematically formulated (al- 
though the clinician himself exemplifies 
these laws and can therefore “utilize” 
them ); in still other cases there is no form- 
ula because nobody has bothered to make 
one. In any of these three circumstances, 
we use our heads because there isn’t any- 
thing else to use. This presumably will be 
tue of many special prediction situations 
for years to come. The logical analysis of 
the first two situations—open-endedness 
and unknown psychological laws—is a fas- 
cinating subject in its own right, especially 
in relation to psychotherapy. But since our 
original question implies that a formula 
does exist, we will say no more about that 
subject here. 

Suppose then that we have a prediction 
equation (or an actuarial table) which has 
been satisfactorily cross-validated. Let us 
say that it predicts with some accuracy 
which patients will respond well to inten- 
sive outpatient therapy in our VA clinic. 
We are forced to make such predictions be- 
cause our staff-patient ratio physically pre- 
cludes offering intensive treatment to all 
cases; also we know that a minority, such 
as certain latent schizophrenias, react ad- 
versely and even dangerously. The equation 
uses both psychometric and non-psycho- 
metric data. It may include what the Cor- 
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nell workers called “Stop” items—items 
given such a huge weight that when pres- 
ent they override any combination of the 
remaining factors. It may be highly pat- 
terned, taking account of verified inter- 
action effects. 

So here is veteran Jones, whose case is 
under consideration at therapy staff. The 
equation takes such facts as his Rorschach 
F+-,, his Multiphasic code, his divorce, his 
age, his 40 per cent service-connection, 
and grinds out a probability of .75 of “good 
response to therapy.” (The logicians and 
theoretical statisticians are still arguing 
over the precise meaning of this number as 
applied to Jones. But we are safe in saying, 
“If you accept patients from this popula- 
tion who have this score, you will be right 
3 times in 4.”) Here is Jones. We want to 
do what is best for him. We don’t know 
for sure, and we can’t, by any method, 
actuarial or otherwise. We act on the 
probabilities, as everyone does who chooses 
a career, takes a wife, bets on a horse, or 
brings a lawsuit. (If you object, as some 
of the more cloud-headed clinikers do, to 
acting on “mere probabilities,” you will 
have to shut up shop, because probabili- 
ties are all you'll ever get.) 

But now the social worker tells us that 
Jones, age 40, said at intake that his mother 
sent him in. The psychology trainee de- 
scribes blocking and a bad F— on Ror- 
schach VII; the psychiatrist adds his com- 
ments, and pretty soon we are concluding 
that Jones has a very severe problem with 
mother-figures. Since our only available 
therapist is Frau Dr. Schleswig-Holstein, 
who would traumatize anybody even with- 
out a mother-problem, we begin to vacil- 
late. The formula gives us odds of 3 to 1 
on Jones; these further facts, not in the 
equation, raise doubts in our minds. What 
shall we do? 


Importance of ‘Special Cases’ 


In my little book on this subject, I gave 
an example which makes it too easy (5, 
p. 24). If a sociologist were predicting 
whether Professor X would go to the movies 
on a certain night, he might have an equa- 
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tion involving age, academic specialty, and 
introversion score. The equation might 
yield a probability of .90 that Professor X 
goes to the movie tonight. But if the family 
doctor announced that Professor X had just 
broken his leg, no sensible sociologist would 
stick with the equation. Why didn’t the 
factor of “broken leg” appear in the form- 
ulaP Because broken legs are very rare, 
and in the sociologist’s entire sample of 
500 criterion cases plus 250 cross-validating 
cases, he did not come upon a single in- 
stance of it. He uses the broken leg datum 
confidently, because “broken leg” is a sub- 
class of a larger class we may crudely de- 
note as “relatively immobilizing illness or 
injury,” and movie-attending is a subclass 
of a larger class of “actions requiring mod- 
erate mobility.” There is a universally rec- 
ognized “subjective experience table” which 
cuts across sociological and theatrical cat- 
egories, and the probabilities are so close 
to zero that not even a sociologist feels an 
urge to tabulate them! (That this is the 
correct analysis of matters can be easily 
seen if we ask what our sociologist would 
do if he were in a strange culture and had 
seen even a few legs in casts at the 
movies? ) 

I suppose only the most anal of actuaries 
would be reluctant to abandon the equation 
in the broken leg case, on the ground that 
we were unable to cite actual statistical 
support for the generalization: “People with 
broken legs don’t attend movies.” But clin- 
icians should beware of overdoing the brok- 
en leg analogy. There are at least four as- 
pects of the broken leg case which are 
very different from the usual “psycho- 
dynamic” reversal of an actuarial predic- 
tion. First, a broken leg is a pretty objec- 
tive fact, determinable with high accuracy, 
if you care to take the trouble; secondly, 
its correlation with relative immobilization 
is near-perfect, based on a huge N, and 
attested by all sane men regardless of race, 
creed, color, or what school granted them 
the doctorate; thirdly, interaction effects 
are conspicuously lacking—the immobiliza- 
tion phenomenon cuts neatly across the oth- 
er categories under study; fourthly, the pre- 
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diction is mediated without use of any 
doubtful theory, being either purely taxo. 
nomic or based upon such low-level th 
as can be provided by skeletal mechanics 
and common sense. The same cannot be 
said of such an inference as “Patient Jones 
has an uaconscious problem with mother. 
figures, and male patients with such prob 
lems will not react well in intensive therapy 
with Frau Dr. Schleswig-Holstein.” 


Theoretical Derivation of Novel Patterns 


When the physicists exploded the first 
atomic bomb, they had predicted a novel 


‘occurrence by theoretical methods. No ac 


tuarial table, based upon thousands of 
combinations of chemicals, would have led 
to this prediction. But these kinds of 
theoretical derivations in the developed 
sciences involve combining rigorously form- 
ulated theories with exact knowledge of the 
state of the particular system, neither of 
which we have in clinical psychology. Yet 
we must do justice to the basic logical claim 
of our clinician. I want to stress that he is 
not in the untenable position of denying 
the actuarial data. He freely admits that 
75 per cent of patients having Jones’ form- 
ula score are good bets for therapy. But he 
says that Jones belongs to the other 25 per 
cent, and therefore thinks we can avoid one 
of our formula’s mis-predictions by counter 
manding .the formula in this case. There is 
nothing intrinsically wrong with this sug- 
gestion. Perhaps the clinician can identify a 
subclass of patients within the class having 
Jones’ actuarial attributes, for which the 
success rate is less than .5. This would be 
perfectly compatible with the over-all ac- 
tuarial data, provided the clinician doesn't 
claim it too often. 

At this point the actuary, a straightfor- 
ward fellow, proposes that we tabulate the 
new signs mentioned in staff conference 
as indicating this subclass before proceed- 
ing further. Here we again reduce our 
clinician to a hypothesis-suggestor, and 
seem to put the current prediction prob- 
lem back on an actuarial basis. But wait. 
Are we really prepared to detail someone 
to do such “case-oriented” research every 
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tine a clinical prediction is made? Actual- 
ly it is impossible. It would require a super- 
file of punch-cards of colossal N to be avail- 
able in each clinic, and several major staff 
doing nothing but running case-oriented 
minor studies while clinical conferences 
went into recess pending the outcomes. 

However, this is a “practical” objection. 
Suppose we circumvent it somehow, so that 
when a sign or pattern is used clinically 
to support a counter-actuarial prediction, 
we can proceed immediately to subject the 
sign to actuarial test on our clinic files. 
There are serious difficulties even so. Un- 
less the several staff who produced these 
records had in mind all of the signs that 
anybody subsequently brings up, we have 
no assurance that they were looked for or 
noted, Anyone who has done file research 
knows the frustration of having no basis 
for deciding when the lack of mention of 
a symptom indicates its absence. But even 
ignoring this factor, what if we find only 
$8 cases in the files who show the pattern? 
Any split among these 8 cases as to therapy 
outcome is statistically compatible with a 
wide range of parameter values. We can 
neither confirm nor refute, at any respect- 
able confidence level, our clinician’s claim 
that this pattern brings the success-prob- 
ability from .75 to some value under .5 (he 
doesn’t say how far under). 

Here the statistician throws up his hands 
in despair. What, he asks, can you do with 
a clinician who wants to countermand a 
known probability of .75 by claiming a 
subclass probability which we cannot esti- 
mate reliably? And, of course, one won- 
ders how many thousands of patients the 
dinician has seen, to have accumulated a 
larger sample of the rare configuration. He 
also is subject to sampling errors, isn’t he? 


Non-frequentist Probability 
and Rational Action 


This brings us to the crux of the matter. 
Does the clinician need to have seen any 
cases of “mother-sent-me-in” and Card VII 
blockage who were treated by female thera- 
pists? Here we run into a philosophical is- 
sue about the nature of probability. Many 
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logicians (including notably Carnap, 
Kneale, Sellars, and most of the British 
school) reject the view (widely held 
among applied statisticians) that probabil- 
ity is always frequency. Carnap speaks of 
“inductive probability,” by which he means 
the logical support given to a hypothesis 
by evidence. We use this kind of probabil- 
ity constantly, both in science and in daily 
life. No one knows how to compute it ex- 
actly, except for very simple worlds de- 
scribed by artificial languages. Even so, 
we cannot get along without it. So our 
clinician believes that he has inductive 
evidence from many different sources, on 
different populations, partly actuarial, part- 
ly experimental, partly anecdotal, that there 
is such a psychological structure as a 
“mother-surrogate problem.” He adduces 
indirect evidence for the construct validity 
(1) of Rorschach Card VII reactions. I 
am not here considering the actual scien- 
tific merits of such claims in the clinical 
field, on which dispute still continues. 
But I think it important for us to under- 
stand the methodological character of the 
clinician’s rebuttal. If Carnap and some of 
his fellow-logicians are right, the idea that 
relative frequency and probability are syn- 
onymous is a philosophical mistake. 

Of course there is an implicit future ref- 
erence to frequency even in this kind of in- 
ductive argument. Carnap identifies in- 
ductive probability with the betting odds 
which a reasonable man should accept. I 
take this to mean that if the clinician de- 
cided repeatedly on the basis of what he 
thought were high inductive probabilities, 
and we found him to be wrong most of the 
time, then he was presumably making er- 
roneous estimates of his inductive prob- 
abilities. The claim of a high inductive 
probability implies an expectation of being 
right; in the long run, he who (correctly) 
bets odds of 7:3 will be able to point to a 
hit-rate of 70 per cent. But this future refer- 
ence to success-frequency is not the same as 
the present evidence for a hypothesis. This 
seems a difficult point for people to see. 
As a member of a jury, you might be will- 
ing to bet 9 to 1 odds on the prisoner's 
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guilt, and this might be rational of you; 
yet no calculation of frequencies consti- 
tuted your inductive support in the present 
instance. The class of hypotheses where 
you have assigned an inductive probability 
of .9 should “pan out” 90 per cent of the 
time. But the assignment of that inductive 
probability to each hypothesis need not it- 
self have been done by frequency methods. 
If we run a long series on Sherlock Holmes, 
and find that 95 per cent of his “recon- 
structions” of crimes turn out to be valid, 
our confidence in his guesses is good in 
part just because they are his. Yet do we 
wish to maintain that a rational man, ig- 
norant of these statistics, could form no 
“probable opinion” about a particular Hol- 
mesian hypothesis based on the evidence 
available? I cannot think anyone wants to 
maintain this. 

The philosophical recognition of a non- 
frequency inductive probability does not 
help much to solve our practical problem. 
No one has quantified this kind of prob- 
ability (which is one reason why Fisher 
rejected it as useless for scientific pur- 
poses). Many logicians doubt that it can 
be quantified, even in principle. What then 
are we to say? The clinician thinks he has 
“high” (How highP Who knows?) induc- 
tive support for his particular theory about 
Jones. He thinks it is so high that we are 
rationally justified in assigning Jones to 
the 25 per cent class permitted by the 
formula. The actuary doubts this, and the 
data do not allow a sufficiently sensitive 
statistical test. Whom do we follow? 


Monitoring the Clinician 


Well, the actuary is not quite done yet. 
He has been surreptitiously spying upon 
the clinician for, lo, these many years. The 
mean old scoundrel has kept a record of 
the clinician’s predictions. What does he 
find, when he treats the clinician as an 
empty decision-maker, ignoring the induc- 
tive logic going on inside him? Let me 
bring you up to date on the empirical evi- 
dence. As of today, there are 27 empirical 
studies in the literature which make some 
meaningful comparison between the pre- 
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dictive success of the clinician and the 
statistician. The predictive domains in- 
clude: success in academic or military 
training, recidivism and parole violation, 
recovery from psychosis, (concurrent) per- 
sonality description, and outcome of psy- 
chotherapy. Of these 27 studies, 17 show a 
definite superiority for the statistical meth- 
od; 10 show the methods to be of about 
equal efficiency; none of them show the 
clinician predicting better. I have reserva- 
tions about some of these studies; I do not 
believe they are optimally designed to ex- 
hibit the clinician at his best; but I submit 
that it is high time that those who are so 
sure that the “right kind of study” will 
exhibit the clinician’s prowess, should do 
this right kind of study and back up their 
claim with evidence. Furthermore, a good 
deal of routine clinical prediction is going 
on all over the country in which the data 
available, and the intensity of clinical con- 
tact, are not materially different from that 
in the published comparisons. It is highly 
probable that current predictive methods 
are costly to taxpayers and harmful to the 
welfare of patients. 

Lacking quantification of inductive prob- 
ability, we have no choice but to examine 
the clinician’s success-rate. One would 
hope that the rule-of-thumb assessment of 
inductive probability is not utterly unre- 
liable. The indicated research step is there- 
fore obvious: We persuade the clinician to 
state the odds, or somehow rate his “con- 
fidence,” in his day-by-day decisions. Even 
if he tends over-all to be wrong when 
countermanding the actuary, he may still 
tend to be systematically right for a high- 
confidence sub-set of his predictions. Once 
having proved this, we could thereafter 
countermand the formula in cases where 
the clinician expresses high confidence in 
his head. It is likely that studies in a great 
diversity of domains will be required be- 
fore useful generalizations can be made. 

In the meantime, we are all continuing 
to make predictions. I think it is safe to say, 
on the present evidence, that we are not as 
good as we thought we were. The — 
ment of powerful actuarial methods co 
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today proceed more rapidly than ever be- 
fore. Both theoretical and empirical con- 
siderations suggest that we would be well 
advised to concentrate effort on improving 
our actuarial techniques rather than on the 
calibration of each clinician for each of a 
large number of different prediction prob- 
lems. How should we meanwhile be mak- 
ing our decisions? Shall we use our heads, 
or shall we follow the formula? Mostly we 
will use our heads, because there just 
im’t any formula, but suppose we have a 
formula, and a case comes along in which 
it disagrees with our heads? Shall we then 
use our heads? I would say, yes—provided 
the psychological situation is as clear as a 
broken leg; otherwise, very, very seldom. 
Received August 1, 1957. 
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The Problem 


Every agency which extends services to 
the public has an obligation to evaluate 
the effectiveness of those services. This 
study represents an attempt to evaluate 
the services rendered during the first four 
years (October, 1945 to October, 1949) of 
the operation of the University of Chicago 
Counseling Center. It does not seek to 
evaluate whether the services were effec- 
tive in the reordering of disturbed per- 
sonalities. The study is aimed at evalua- 
tion of the services solely through the 
satisfaction with the services as reported 
by clients. The study was undertaken as 
a desirable preliminary step to any fol- 
low-up study based upon interviewing 
methods which might seek to establish 
the psychotherapeutic effectiveness of the 
services. 


Procedures 


From the files of the Counseling Center 
190 names were selected so as to sample 
systematically each month of each of the 
four years of service. This procedure sam- 
pled the clients of 50 different counselors. 
Four of the counselors were full members 
of the staff with doctoral degrees in psy- 
chology. Five counselors were full mem- 
bers of the staff but had not yet completed 
their doctoral degrees. One counselor was 
a psychiatrist who was at the Center to 
further his own training. The remaining 
40 were graduate externes who had com- 
pleted a year of theoretical and practicum 

1Appreciation is expressed to Elise Elkins and 
Robert Bauer for their assistance in the early 
stages of this study The investigation was con- 
ducted at the University of Chicago and is in no 
way related to the work of the RAND Corporation. 


training in client-centered therapy. All in- 
terviews were client-centered in orienta- 
tion. 

A questionnaire was mailed to each of 
the 190 client names selected. A cover 
letter requested the clients’ cooperation 
and explained the Center’s interest in the 
reaction of clients to the services offered 
them. The questionnaire asked each cli- 
ent: (a) to rate on an eleven-point scale 
his recollection of the degree of help or 
harm he felt he had received at the time 
of his closing interview; (b) to rate on the 
same eleven-point scale his present evalua- 
tion of the help or harm he had received 
from his counseling; (c) to rate on the same 
eleven-point scale the help or harm he 
felt he had received from any and all 
sources of help consulted before coming 
to the Center; (d) to rate any and all 
sources consulted after closing the contact 
with the Center; and (e) to describe any 
changes he saw in his personal situation 
between the time he first came to the Cen- 
ter and the time of answering the ques- 
tionnaire. 

In those cases where questionnaires were 
not returned within two months, up to 
three follow-up questionnaires were sent. 
The returns continued to come in for al- 
most a year. Receipts were closed at the 
end of a year and analysis of the results 
begun. 


Results 


Of the 190 names, 8 were those of par- 
ents of children in play therapy and of 
persons who had participated in a testing 


program during a period of inadequate | the 


record keeping. In 46 cases no adequate 
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; Table 1 
ity Observed and Expected Distributions of Each Population 
by Sex and Student Status 
Population Females Males Totals 
Student — Nonstudent Student  Nonstudent 
oO e °o e oO e oO e 
Responding 17 (18) 22 (28) 48 (41) 15 (20) 102 
Not Responding Tt® 10 ( 8) 11 (14) 6 ( 6) 84 
: Not Reached 8 ( 8) 9 (10) 15 (19) 14 { 9) 46 
Il in- Totals 82 41 74 35 182 
enta- 
ch of forwarding address was available. In 84 case. These data were taken from the Cen- 
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cases neither the original questionnaires 
nor the follow-ups, were ever returned. 
A balance of 102 usable questionnaires, 
then, constitute the basic data of the study. 


Comparisons of Groups Responding, 
Not Responding, and Not Reached 

The first question to be answered relates 
to whether the “not responding” group 
and/or the “not reached” groups differ in 


ter records. The mean numbers of inter- 
views are presented in Table 3. Analysis 
of variance failed to disclose any differ- 
ences between those responding, not re- 
sponding, and those not reached which 
could not be accounted for by chance. 


Table 2 


Mean Ages of Each Response Population 
by Sex and Student Status 











any identifiable way from the “respond- Population Females Males 

ing” group. If no clear differences are New: Nea 
found, then the questionnaire responses of Student student Student student 
the “responding” group may be treated as Responding 23.00 92.16 2414 2027 
probably representative of the total popu- Not responding 21.80 30.63 28.63 26.50 
lation. Not reached 28.00 82.38 24.67 28.38 


Table 1 presents the observed and ex- 
pected distributions of each population by 
sex and student status. Chi-square analysis 
of the differences between the numbers 





Table 8 
Mean Numbers of Interviews Per Case for Each 














ques: | Of those responding, not responding and Population by Sex and Student Status 
were | 20t reached in each of the four groups Population Females Males 
p to show no significant differences (p > .20). Non- Non- 
pt The three populations were next com- Student student Student student 
a pared by analysis of variance with regard Responding 7.00 10.00 580 547 
t the | 8ge- These data were taken from the Not responding 5.00 12.55 6.82 10.67 
sults | 8istration cards filled out at the time of Not reached 6.75 6.11 6.07 3.77 
the first interviews. The mean ages are 
presented in Table 2. ‘While in every case Since comparisons of percentages of re- 
the students are significantly younger than sponse, age differentials, and numbers of 
the nonstudents, when all mean ages are interviews per case yielded no significant 
pal }compared, no significant differences evidence that one response group differed 
d of emerge between the ages of those respond- from the others, the completed question- 
sting | ing, not responding, and not reached, so naires were treated as if they came from 
juate | the hypothesis that age affected who re- a representative sample of the population, 
juate | sponded and who did not was rejected. and the results are presented as probably 





The samples were next compared with 
tespect to the number of interviews per 


representative of the Center’s total popu- 
lation of cases. 
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Fig. 1. Present and retrospective evaluations of help received. 


Comparison of Ratings of Help 
or Harm Received 

Figure 1 presents a scatter plot of the 
ratings of “help” or “harm” received for 
the time of the closing interview and the 
present time of answering the question- 
naire. The data for only 90 cases are pre- 
sented because in 12 cases the respondents 
failed to give complete replies. As an aid 
to visual analysis, lines have been drawn 
to mark off the regions representing clear 
expressions of having been “helped,” 
neither “helped” nor “harmed,” and 
“harmed.” Approximately one-third of the 
respondents were consistent in their evalu- 
ations as having been clearly “helped.” 
This is in contrast to the one person who 
continued to feel he had been “harmed.” 
From the comments on his questionnaire, 
the one person who reported having origi- 
nally been neither “helped” nor “harmed” 
but who currently felt he had been harmed 
apparently changed his mind after enter- 
ing psychoanalysis. When one bears in 
mind that 80 per cent of the counselors 
involved were in a training status, the 
markedly greater proportion of clients 
evaluating their contacts as “helpful” rath- 


er than “harmful” is a most evocative 
result. 

Because counselors at the Center have 
often felt that the services rendered have 
been improving as the years pass, the rat- 
ings were analyzed according to the year 
in which the client entered counseling. 
The distributions of ratings by each year 
of service are presented in Table 4. No 
clearly significant differences in the pro- 
portions of ratings of 8 or above (the region 
of clear expression of “help” received) were 
found by chi-square analyses, although a 
general increase in average ratings is ap 
parent, and a comparison of the first and 
fourth years’ ratings yielded a difference 
in the expected direction at the 20 per 
cent level of confidence. There is no way, 
of course, to determine from the data at 
hand whether or not this possible trend 
reflects in some way an improvement in 
quality of service or some other factor such 
as a possible “gratitude-effect” which is 
stronger among those who have been cout 
seled more recently. 

In order to determine whether or not 
the ratings were influenced by any one 
group such as students, nonstudents, males 
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Table 4 
Ratings Given by Clients Seen in Each 
Year of Service 
Rating for Time of Closing Interview Rating for Time of Study 

Rating §Istyr. Qndyr. Srdyr. 4thyr. Rating Ist yr. Qndyr. Srdyr. 4thyr. 
ll 8 2 ll 1 8 2 
10 1 1 1 2 10 1 1 2 

9 1 4 4 5 9 2 2 1 2 
ee ee 4 9 8 3 Sr ee ae 
| 2 8 ae OE ee ee 3 4 4 
6 5 8 9 8 6 5 6 9 ll 

5 1 1 1 5 2 1 

4 1 1 4 1 

8 8 

2 2 1 

1 1 
No Data 2 2 8 4 No Data 2 2 8 1 
N 16 21 $1 84 N 16 21 $1 34 
M 6.86 7.58 7.64 7.83 M 6.98 7.58 7.21 748 





or females, the data were analyzed for such 
effects. No significant differences were 
found by chi-square analyses of those giv- 
ing ratings in the region of clear expres- 
sion of “help” received. The distributions 
of ratings appear in Table 5. 

To determine whether the ratings were 
influenced by the number of interviews 
per case, two steps were taken. First, scat- 
ter plots were prepared of ratings and 
number of interviews (in class intervals 
of 3) for both time points (time of closing 
interview and present time). These plots 


are presented in Figures 2 and 8. Again 
broken lines are used to mark off the re- 
gions of clear expressions of “help” and 
“harm.” They show that all expressions 
of clear “harm” come from persons who 
had 6 or fewer interviews and that per- 
sons having 16 or more interviews always 
gave ratings clearly expressing a sense of 
having received help. The second step was 
to take both sets of data and subject them 
to analysis of variance. In both sets the 
positive relationship between favorable- 
ness of rating and number of interviews 




















Table 5 
Ratings Given for Closing Interview and Presentby Clients of Each Sex and Student Status Group 
Rating MALES FEMALES 
Student Nonstudent Student Nonstudent 
Closing Present Closing Present Closing Present Closing Present 
il 5 4 2 
10 8 2 2 2 
9 6 4 1 3 5 2 
i oo ae 4 5 6 5 8 7 
7 14 10 <_ UGlO e ee 
6 9 12 5 7 2 8 4 4 
5 1 8 1 1 
4 1 1 1 
8 
2 1 
1 
No Data 2 2 2 1 8 8 4 2 
N 47 47 15 15 18 18 22 22 
M 7.78 7.49 6.92 7.00 7.58 6.80 7.56 8.10 
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Fig. 8. Relationship of rating to number of interviews: Retrospective ratings. 


is significant beyond the .01 level of con- 
fidence. There is, of course, no way of 
determining from the data at hand wheth- 
er this relationship reflects more actual 
help received with greater number of in- 
terviews or some other phenomenon, such 
as stronger transference accompanying 


more interviews or greater gratitude ac 
companying greater dependency. 

To determine whether or not discrete 
steps existed in the relationship of increas- 
ing favorableness of rating and increasing 
number of interviews, a one-tailed test of 
significance was used. Chi-square analyses 
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were made and the obtained p values di- 
vided by 2. Where cell entries were small, 
Fisher’s exact method was used. The levels 
of significance obtained, as well as the 
scattergrams, suggest that each successive 
group of interviews tends to add to the 
likelihood of more favorable ratings up to 
12 interviews, after which the ratings re- 
main distributed throughout the same re- 
gion of a clear expression of having re- 
ceived help. 


Comparisons of Groups Seeking Help 
Before and After Contact with the 
Counseling Center . 


The proportion of low raters (ratings of 
5 or below) who reported having sought 
help elsewhere before coming to the Cen- 
ter were compared with the proportion 
of low raters (5 or below) who did not 
report having been elsewhere. A chi-square 
analysis yielded a difference at the .10 
level of confidence in favor of the “prior 
help” group’s contributing more frequent- 
ly to the low ratings. This finding is sug- 
gestive of a possible “clinic-shopper” group, 
a group which goes from place to place, 
experiencing little or no satisfaction with 


| the help offered. 


There were 36 individuals who reported 
having gone to some other source of help 
before coming to the Center: 20 having 
gone to only one prior source, 8 to two 
prior sources, 6 to three prior sources, and 
leach to four and five prior sources. The 
proportions of those in the “two-or-more- 
prior-sources” group who gave present rat- 
ings of “help” received at the level of 8 
or above were compared by chi-square 
analysis with the proportion of the “one- 
prior-source” group who gave ratings of 8 
or above. The “two-or-more-prior-sources” 
group turned in significantly fewer of the 
high ratings (p = .05). When compared 
with the “no-prior-source” group, the dif- 
ference was in the same direction and 
more clearly significant (p = .01). 

When the “two-or-more-prior-sources” 
group was compared through the chi- 
square analysis with the “one-prior-source” 
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group in terms of the proportions seeking 
help after leaving the Center, significantly 
more of the “two-or-more-prior-sources” 
group were found to continue seeking 
help (p = 02). The proportion of the 
“two-or-more-prior sources” group who 
sought further help was significantly great- 
er than in the “no-prior-source” group at 
the .01 level of confidence. No signifi- 
cant difference was found between the 
“one-prior-source’ and the “no-prior- 
source” groups, although the same ten- 
dency appeared for those who had pre- 
viously sought help to continue to seek 
it (p = .30). 

When the 36 questionnaires reporting 
consultation with other sources prior to 
coming to the Center were tabulated, it 
was found that professional sources (psy- 
chiatrist, psychological counselor, voca- 
tional counselor) had been sought 30 times 
and nonprofessional sources (family phy- 
sician, minister, priest, rabbi, friend or 
acquaintance) 33 times. As was reported 
earlier, 24 of these 36 people sought help 
after leaving the Center, consulting 23 
professional and only 9 nonprofessional 
sources, The difference in favor of sub- 
sequent professional consultation is sig- 
nificant at the .02 level of confidence. 

In order to check on whether or not 
confidence could be placed in the notion 
that the contacts at the Center contributed 
to the increase in the favoring of profes- 
sional contacts, two steps were taken. The 
proportions of professional vs. nonprofes- 
sional subsequent contacts made by the 
“no-prior-sources” group was compared 
first with the proportions in the prior con- 
tacts of the “prior-sources” group, and 
second with the proportions in the subse- 
quent contacts of the “prior-sources” group. 
These chi-square analyses yielded differ- 
ences in the expected directions at the .02 
and .30 levels of confidence respectively. 
They indicate that the “no-prior-sources” 
group and the “prior-sources” groups do 
not significantly differ in terms of propor- 
tions of professional-nonprofessional con- 
tacts subsequently made, but that they 
do differ from the proportions of contacts. 
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made by the “prior-sources” group prior 
to coming to the Center. 


Some Miscellaneous Comparisons 


There is no evidence that like-sex or 
opposite-sex of the counselor contributed 
to the favorableness of ratings. 

Likewise, there is no evidence that the 
counselor’s length of experience contrib- 
uted to favorableness of ratings. Only 2 
or 8 cases of each of the 50 counselors 
were sampled; hence, no person-to-person 
comparisons were possible. Inspection 
showed variability of ratings for practically 
every counselor. One must bear in mind 
that more experienced counselors are more 
apt to be assigned more serious cases. 

For those clients who had consulted 
sources prior to coming to the Center, the 
ratings assigned to the first source, second 
source, and so on, were compared. The 
comparisons showed no evidence of dif- 
ferences in mean ratings or range of rat- 
ings. The ratings assigned to the last 
sources consulted prior to the clients’ com- 
ing to the Center were correlated with 
ratings assigned to the Center experience 
at the present time (r = 0.34). 

Of the 66 persons for whom the Center 
was the first source of help, 16 (25 per 
cent) reported seeking further help after 
leaving the Center, 21 (80 per cent) re- 
‘ported no need to look further, and 15 
{283 per cent) reported the desire for or 
tthe contemplation of further help. 

No relationships were discovered be- 
tween the level of rating for the service 
at the Center and the source next con- 
sulted. Thus, it was not low raters who 
subsequently sought professional help and 
high raters who turned to nonprofessional 
sources, or vice versa, or any other con- 
sistent relationship. 


Summary 
Names of 190 clients were selected so as 
to sample the population which sought the 
services of the University of Chicago Coun- 
seling Center during the four years fol- 
lowing its establishment in October, 1945. 
By questionnaire these clients were asked 
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to indicate on an eleven-point scale (a) 
the help they received at the Center as 
they valued it at the time of the closing 
interview, (b) the help they received as 
they valued it at the time of the study, 
(c) the help they received from any source 
prior to coming to the Center, and (d) the 
help they received from any sources sub- 
sequent to their contact with the Center. 

Approximately 75 per cent of those who 
could be reached or presumed to be 
reached returned the questionnaire. There 
were no discernible differences of signifi- 
cance between the groups which did and 
did not return the questionnaires or were 
not reached. The questionnaires were 
treated as representative of the total popu- 
lation sampled. 

Of 90 cases giving ratings for the time 
of the closing interview and the present 
time, 34 were consistent in rating in the 
region of a clear expression “help” re- 
ceived, while only 1 person consistently 
rated in the region of a clear expression 
of “harm” received. 

A tendency was noticed for the ratings 
to increase with each successive year of 
service. 

Favorableness of rating was not found 
to be attributable to any one group: stu- 
dent-nonstudent or male-female. 

Favorableness of ratings was found to 
be significantly related to increased num- 
bers of interviews and there was evidence 
that each increase in number of interviews 
added to the likelihood of higher ratings. 

There was evidence found suggestive of 
a “clinic-shopper” group, a group that had 
sought help elsewhere before coming to 
the Center and tended to seek help else- 
where after leaving the Center. This group 
accounted for proportionately more of the 
low ratings. 

The results were interpreted as signifi- 
cant by reason of (a) their description of 
differences which ought to be taken into 
account in the planning of follow-up 
studies designed to establish the efficacy 
of the counseling; (b) the increased con- 
fidence they engender in the notion that 
a training center can operate a service 
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valued in the community; and (c) the op- 
portunity provided for speculations regard- 
ing the efficacy of the therapy involved. 


Received January 2, 1957. 


Comment 


Dr. Porter wisely indicates early in his 
paper the distinction between the effec- 
tiveness of counseling and the expressed 
satisfaction of clients. Presumably all 
counselors are aware of the constant need 
to evaluate the effectiveness of their work 
but less attention has been given to the 
important problem discussed in this paper, 
the attitudes of couhselees toward counsel- 
ing as expressed by their satisfaction with 
the service. 

Frequently during counseling, anxiety is 
aroused, habitual patterns of adjustment 
are disturbed, and uncomfortable self-ex- 
ploration is encouraged. A result of this 
may be increasing dissatisfaction of the 
client, but this dissatisfaction is self-lim- 
ited. When the client reaches a certain 
point of dissatisfaction, he terminates coun- 
seling. 

Even when counseling has been accom- 
panied by dissatisfaction and yet results 
favorably for the client, the client may 
fail to see a relationship between the 
counseling he received and his improved 
status. Thus the relationship between ef- 
fectiveness of counseling and satisfaction 
of the client, even as determined a long 
time after counseling, may be a low one. 

Counselors, like most other people, like 
to be liked, and many of us are of the 
opinion that if too many persons are dis- 
satisfied with their counseling experiences, 
and this dissatisfaction persists, society 
eventually will not support counseling with 
much enthusiasm. Thus Porter’s attempt 
to determine how satisfied his agency’s 
clients were is a commendable one. 

Client satisfaction was one of the earli- 
est criteria used in attempts to evaluate 
counseling. Insofar as early critics recog- 
nized that client satisfaction was not an 
Objective of counseling but rather a con- 
dition that accompanied success or failure 
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in arriving at more relevant objectives, this 
criterion, although popular and frequently 
used, never has been too respectable sci- 
entifically. In some counseling centers 
groups of clients have been identified who 
persistently refused to express dissatisfac- 
tion with counseling in spite of other 
knowledge suggesting that the counseling 
itself has been otherwise ineffective. 

One unanswered question concerns the 
effect of memory upon one’s felt satisfac- 
tion with counseling. In Porter’s study, 
presumably one-quarter of the sample re- 
ceived counseling at least four years prior 
to the time they were asked to indicate 
their degree of satisfaction, and the re- 
mainder of the sample had varying but 
less time intervening between counseling 
and the time of the study. What are the 
effects of time upon recalled satisfaction? 
The results here suggest that nonstatistical- 
ly significant differences are found from 
year to year, with clients from the earlier 
years expressing least satisfaction. Is this 
an effect of memory, of changing services 
provided by counselors, or of changes in 
the case load itself? 

Another question concerns the adequacy 
of the sample. Of the 190 names drawn 
from the files, only 54 per cent were in- 
cluded in the analysis. The 54 per cent 
were reported to be representative of the 
total group of 190 upon the basis of sex, 
age, student status, and number of inter- 
views. Were these 102 persons, however, 
characteristic of the 190 upon the basis of 
their satisfaction with counseling? One 
might guess that a few persons extremely 
dissatisfied might so indicate several years 
later, but otherwise that a positive rela- 
tionship would appear between felt satis- 
faction with counseling and tendency to 
respond to such questionnaires. Thus, one 
cannot use Porter's figures to arrive at a 
satisfactory estimate as to the number of 
persons satisfied with counseling, but per- 
haps one can more safely accept the con- 
clusions concerning the relationship be- 
tween satisfaction and the other variables. 

Any study such as this is limited also 
by the relationship between satisfaction 
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and number of interviews. Those persons 
with least satisfaction are most likely to 
terminate early even though many of these 
persons, if they had continued somewhat 
longer, might express more satisfaction 
and actually might be among the clients 
receiving most from counseling. 

A natural extension of the research re- 
ported in this paper involves the relation- 
ship between the expectations of clients 
prior to counseling and their perceptions 
of counseling during the process and at 
periodic intervals after termination. Are 
certain kinds of expectations characteristic 
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of persons who later express dissatisfac- 
tion? How are the client’s changes in satis. 
faction during counseling related to what 
the counselor does and to other changes 
in the client’s behavior? Perhaps now 
enough attention has been paid to the 
question as to whether or not clients are 
satisfied with counseling and we can be- 
gin to explore more systematically the 
meaning of this satisfaction or dissatisfac- 
tion. 


Ralph F. Berdie 
University of Minnesota 
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Many guidance and counseling programs 
are maintained by educational institutions, 
governmental agencies, and industrial and 
private concerns. Although the nature of 
these programs runs the gamut, they are 
all in some way concerned with prediction. 
The extent to which such predictions are 
realized has been the subject of a num- 
ber of investigations. However, the results 
of such validity studies have not always 
been in agreement. Undoubtedly selective 
factors and methodological differences ac- 
count for some of the disagreement. 

Many such studies have been made in 
an effort to evaluate the effectiveness of 
different kinds of guidance and counsel- 
ing programs for college students. Hes- 
tn (8) using an opinion questionnaire 
found both students and parents highly 
pleased with the results of an educational 
guidance clinic. Goodrich (1) found that 
three experimental summer counseling 
dinics did help students in their first term 
adjustment in college. Guthrie and 
ONeill (2) concluded that dormitory coun- 
seling has no effect on academic achieve- 
ment in the absence of the student's de- 
sire for help. After studying 400 pupils 
for four years, Hill (5) concluded that en- 
tollment in college and success after enroll- 
ment were functions of a number of interre- 
lated abilities, attitudes, desires, and values. 


| Kaess and Long (6) acknowledged the lim- 


ited nature of their study but found that 


INote a different type of assessment reported 
by Porter (this issue) and Thrush (Vol. 4, pp. 183- 
190)—Ed. 





The Assessment of an Educational 
Guidance Clinic 


Barron B. Scarborough’ 
The Florida State University 


and 


John C. Wright 
DePauw University 


counseling brought about no significant 
differences either in terms of grades or 
subsequent job satisfaction. Shedd and 
Angelino (7) believed that, broadly speak- 
ing, guidance does not improve academic 
achievement. 

This study also deals with a special type 
of guidance program. Educational guid- 
ance clinics have been held annually at 
DePauw University since 1945 with the 
exception of the years 1951 and 1952. The 
clinic described by Heston (8) was a fore- 
runner of the present clinic. All the clinics 
have followed essentially the same format. 
The primary purpose of this study was to 
gain objective evidence as to the value of 
such a college program. 


Procedure 


The clinics held from 1953 to 1955 were 
under the same direction and were chosen 
for the study as a possible influence on 
first semester grade-point averages. Dur- 
ing this period 188 students attended the 
EGC and subsequently enrolled at De- 
Pauw University. A control sample of 188 
students who did not attend the EGC was 
randomly selected to equate for sex and 
year of enrollment. The statistic selected 
was analysis of covariance. Control vari- 
ables used were the total raw score of 
the American Council on Education Psy- 
chological Examination and a composite 
achievement score (‘ctal scale scores for 
the Cooperative Ger.eral Achievement tests 
of Reading, English, Social Studies, Natur- 
al Science, and hiathematics). 
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The clinics from 1945 to 1950 were un- 
der the same direction. During this time 
142 students who attended the EGC sub- 
sequently graduated in a four-year period. 
These students were used to study the pos- 
sible influence of the EGC on four-year 
grade-point averages. A chi-square was 
computed to determine if there was a sig- 
nificant difference between the number of 
graduates in the EGC group as compared 
with the number graduating in the non- 
EGC group. 

The possibility existed that a difference 
in level of adjustment of the EGC stu- 
dents as compared with the non-EGC stu- 
dents was masking the influence of the 
clinic when grades were used as a cri- 
terion measure. All students who enrolled 
in the EGC and/or DePauw University for 
a like period had been administered the 
Heston Personal Adjustment Inventory.? 
This inventory was considered a screen- 
ing instrument involving six basic com- 
ponents of adjustment (4). For this study, 
significance of differences in means of the 
EGC and non-EGC were obtained for the 
six scales of adjustment. For those ad- 
justment scales which yielded a significant 
difference in means, correlation coefficients 
were computed with first semester grade- 
point averages for the groups entering in 
the years 1953 to 1955. 


Results 


The results of the study of first semes- 
ter grade-point averages are shown in 
Tables 1 and 2. 

Table 1 


Means for the Criterion and Control Variables 
(First Semester Grade-Point Averages) 








Ist Composite 

EGC Sem Achieve- 
Status Sex N GPA ACE-T ment 
Yes PF iS’ Ss ° 118.50 '280.77 
Yes M 75 188 121.76 2538.91 
Subtotal M&F 188 1.45 117.95 245.41 
No F 118 163 121.17 244.538 
No M 75 189 119.68 258.12 
Subtotal M&F 188 1.538 120.57 247.96 
Total M&F 876 149 11926 246.68 








2From 1946 to 1948 inclusive, the Inventory was 
administered in a pre-published form. 
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Table 2 


Analysis of All Sources of Variation 
for First Semester Grade-Point Averages 





Source of 


Variation DF. S.S. MS. F 





in wa 
5 indicat 





EGC Status 1 
Sex 1 
Interaction 1 21 
Within 370 101.59 


*Significant at the .01 level. 


.08 
9.41 


.08 <n 
9.41 84.27" 
21 ~ 

2746 





The only source of variation which gave 
a significant difference was sex. Attend. 
ance at EGC was not a differentiating fac. 
tor in. first semester grades obtained by 
the students. Essentially the same results 
were obtained when grades were consid- 
ered for those completing a four-year 
program. EGC status was not a differenti- 
ating factor while sex was a significant 
factor in the grades obtained. Women ob- 
tained higher grade-point averages than 
men. Tables 3 and 4 indicate these results, 


Table 3 


Means for the Criterion and Control Variables 
(Four-Year Grade-Point Averages) 


Composite 
Achieve- 





EGC 
Status Sex N 


Four-Year 
GPA ACE-T 





Yes F 83 
Yes M 59 
Subtotal M&F 142 


No F 83 
No M 59 
Subtotal M&F 142 


Total M&F 284 


1.78 118.20 
1.74 122.88 
1.76 120.15 


181 115.28 
1.74 119.17 
1.78 116.89 


L.77 «118.52 


250.96 








Table 4 


Analysis of All Sources of Variation 
for Four-Year Grade-Point Averages 


Source of 
Variation D.F. 


EGC Status 1 
Sex 1 
Interaction 1 .0015 
Within 278 42.1178 


*Significant at the .01 level. 





S.S. 


.2816 
2.1177 


M.S. F 


.2816 1.86 
2.1177 13.98° 
.0015 01 

1515 








When the successful completion of the 
four-year curriculum in the normal length 
of time was used as a criterion, EGC status 
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The Assessment of an Educational Guidance Clinic 


again was not a distinguishing factor. Table 
5 indicates a chi-square value of zero.* 
Table 5 


Number of Graduates and Nongraduates 
According to EGC Status 








Graduated 
EGC Status Yes No Total 
Yes 144 100 244 
No a SS 
Total 289 199 488 





The chi-square value is zero. 


Only two scales of the Heston Personal 
Adjustment Inventory yielded significant 
differences. These indicated the women 
in attendance at the EGC were more stable 
emotionally and had greater confidence in 
themselves than did a group of randomly 
chosen women students who did not at- 
tend an EGC (Table 6). No differences 
were found for the men. 


Table 6 


Means and Significances of Differences of 
Adjustment Scores for EGC and Non-EGC 








Mean Scores Mean Scores 
for Women for Men 
Non- Non- 

Adjustment EGC EGC EGC EGC 

Scale N=118 N=118 N=78 N=73 
Analytical 

Thinking 23.52 23.86 25.55 24.78 
Socia- 

bility 29.78 28.68 29.06 80.32 
Emotional 

Stability 28.81 25.68* 80.78 29.49 
Confidence 27.20 24,79** 29.38 28.34 
Personal 
Relations $27.87 26.67 26.67 26.08 
Home Satis- 
faction 41.81 89.71 40.07 40.07 





‘The EGC vs. non-EGC difference is significant at 
the .01 level. 
“The EGC vs. non-EGC difference is significant at 
the .05 level. 


When the two scales yielding significant 
differences for the women were correlated 
with first semester grade-point averages, 
no coefficient exceeded a plus or minus .10. 
Thus, adjustment of the EGC and non- 
_ The slight discrepancy in the number graduat- 
ing, as listed in Tables 8 and 5, is due to the in- 


ability to match completely for sex within the 
year of graduation. 
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EGC groups, as measured by these two 
scales, was not significantly related to first 
semester grades. 

Discussion 

The type of guidance program discussed 
here is somewhat unique. In the clinic a 
concerted effort is made to gain as much 
information as possible about each par- 
ticipant in a four-day period. Test data 
gathered from individual and group con- 
tacts in formal and informal settings are 
afforded several groups of four counselors 
each. These groups of counselors attempt 
to reach a common decision regarding the 
educational and vocational plans of the 
students with whom they are working. The 
directors of the clinic have received nu- 
merous favorable comments from students, 
parents, and participating staff members. 
Yet the results of this paper indicate that 
no advantage accrues to the student par- 
ticipating in the EGC in terms of his 
chances of graduating or in the grades he 
obtains while in college. 

A number of possible mitigating factors 
existed. Nothing was known of the EGC 
participants who did not enroll at DePauw 
University. It was quite possible that con- 
firmation of plans or suggested changes of 
plans had borne fruit. A large proportion 
of the counseling staff of the EGC regu- 
larly served other students in a like ca- 
pacity during the academic year. With the 
exception of special tests given EGC stu- 
dents the test battery was the same for all 
students who entered DePauw. In addi- 
tion, the first two years of course work 
was similar for most students. These and 
other such factors may have operated to 
produce the obtained results. Other areas 
which might prove worthy of investigation 
in similar programs include: adjustment to 
college, type of major, parental orientation, 
and training of staff counselors. Perhaps 
less atomistic research efforts will point up 
some of the values in such programs not 
found in this and similar studies. 


Summary 


When adjustments were made for dif- 
ferences in aptitude and previous achieve- 
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ment level, participation in an EGC of 
the type conducted at DePauw University 
did not seem to be a differentiating factor 
in first semester grade-point averages, four- 
year grade-point averages, or the tendency 
to complete the four-year program at De- 
Pauw. 

Though the women who attended EGC 
obtained higher scores on the Heston Per- 
sonal Adjustment Inventory scales of Emo- 
tional Stability and Confidence than did 
women not attending the clinic, these two 
scales were not significantly correlated 
with first semester grades. Men exhibited 
no differences (EGC vs. non-EGC) on the 
adjustment scales. 

There are other possible criteria of the 
value of this and similar guidance clinics. 
Perhaps more comprehensively designed 
research efforts will reveal some of these 
values. 

Received July 15, 1957. 
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Counseling Research in the Hospital Setting 


Bernard A. Stotsky*? 
VA Hospital, Durham, N. C. and Duke University 


The counseling psychologist is a relative 
newcomer to the hospital although some 
counseling functions have been performed 
in one form or another by. workers from 
other disciplines. Due to the newness of 
the area and the lack of guidelines from 
previous experience, many of the first 
published papers on hospital counseling 
have been concerned with descriptions of 
counseling programs and of the role and 
functions of the counseling psychologist in 
a hospital treatment program (2, 5, 6, 8, 9, 
10, 11, 12, 18, 14, 15, 17, 26, 27). Two (24, 
95) have presented case study illustrations 
of the counseling process. None of these pa- 
pers may be considered as research in the 
sense of controlled experiments. The few 
which report data are actually surveys or 
pilot investigations, and lack even minimal 
controls. The role of the counselor emerges 
as that of a member of a treatment or re- 
habilitation team whose major functions 
are (a) evaluation, (b) counseling, (c) job 
placement, and (d) job follow-up of pa- 
tients, (e) consultative assistance, (f) re- 
search, (g) training of counselors, and (h) 
development of rehabilitation programs. 


Recent Experimental Research 


Up till the present only a small number 
of experimental studies has been reported. 
They fall into two major categories: (a) 
diagnostic and evaluative studies either of 
certain populations or of the effects of 
counseling and rehabilitation procedures, 
and (b) investigations of the counseling 
process. Under the first category comes a 
diverse group of studies. Balinsky (1) re- 
ported that success in vocational adjust- 


1Acknowledgment is made to Herbert H. Co- 
burn for his assistance. 

2Until reecntly the writer was Chief, Counseling 
hei VA Hospital, Brockton, Massachusetts— 


ment of schizophrenics is not related to 
clinical diagnosis, age at hospitalization, or 
previous work experience. Cohen (3) found 
that psychiatric patients with crystallized 
vocational plans tend to maintain them- 
selves outside of the hospital longer. As 
Cohen points out, his conclusion regarding 
the desirability of providing vocational 
counseling for NP patients is not strictly 
warranted from his findings since the plans 
were crystallized without counselor help. 
Differences in vocational preplanning may 
be related to more fundamental personal- 
ity variables. 

Stotsky and Weinberg (22) applied a 
new form of sentence completion test, 
utilizing work-relevant sentence stems for 
comparison of psychiatric patients differ- 
entiated on two work adjustment criteria: 
current performance in rehabilitation ac- 
tivities and outcome of treatment six 
months later. For both criteria differences 
between well performing and poorly per- 
forming patients were significant for 8 out 
of 9 personality variables studied, with 
such variables as “persistence” and “posi- 
tive reactions to failure” most discriminat- 
ing for present adjustment and “self-reli- 
ance,” “persistence,” “goal specificity,” and 
“positive reactions to failure” most dis- 
criminating for six-month outcome. A later 
study by Stotsky (20) showed well perform- 
ing patients to approach normals much 
more closely in their scores than did the 
poorly performing patients. Walter and 
Jones (28) used another form of sentence 
completion test and found a correlation of 
.50 between an attitude score derived from 
the test and successful work performance 
in manual arts activities. Such tests may 
be of value in selecting patients for special 
work and activity programs within the hos- 
pital and after discharge, but need further 
validation on different populations. 
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In another study (Stotsky, 19) a manual 
arts aptitude test developed for manual 
arts patients, the Revised Beta and sub- 
tests of the Detroit Retail Selling adapted 
for educational therapy patients, and an 
interest test devised for both groups were 
administered to two samples of chronic 
schizophrenics from the respective thera- 
pies. Comparison of patients rated above 
with those rated below the median for 
these activities showed significant differ- 
ences for aptitude but not for interest, 
though MAT and ET patients differed 
significantly from each other for both cler- 
ical and mechanical interests. Likewise 
aptitude test scores and performance rat- 
ing scores predicted outcome of treatment 
six months later with accuracy significantly 
beyond chance in both samples. For such 
patients aptitude seems more important 
than expressed interest in predicting out- 
come of rehabilitative treatment. 


A personality measure (Make-A-Sentence 
Test) and a test of knowledge of psychi- 
atric aide duties were able, in combination, 
to predict with 86 per cent accuracy later 
work performance of nursing aid applicants 
(Stotsky, 23). Discrimination by tests tend- 
ed to be better than by interviewer judg- 
ments though differences just fell short of 
significance. Worth noting here is the 
use of criterion groups of currently em- 
ployed good and poor aides as the basis 
for selection of tests and cutting scores 
which were then applied to a new sample 
of applicants to predict later ratings. 

Jones, in an unpublished study using 
Pressey’s X-O Test, found NP patients not 
to have more worries than normals but to 
manifest stricter moral attitudes concern- 
ing behavior. This finding is of interest 
because of its seeming disagreement with 
Mowrer’s conception of the mentally ill as 
being deficient in social responsibility and 
unable to accept society’s injunctions re- 
garding the curbing of narcissistic impuls- 
es. In fairness to Mowrer it should be 
noted that this sample consisted mainly 
of hospitalized psychiatric patients (mostly 
psychotics) whereas his theorization is con- 
cerned with psychoneurotics. 
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Haselkorn (7), using the Strong and Ku. 
der Interest Tests, found that homosexuals 
tended to favor traditional male interests 
less than psychoneurotics and general 
medical patients. Since only 8 of 75 com- 
parisons were significant, extreme caution 
is warranted in generalizing these findings, 

Stotsky, Daston, and Vardack (21) re. 
port a controlled investigation in which the 
experimental variable was the activities of 
the counselor on a ward of acutely dis- 
turbed and regressed patients. The experi- 
mental group showed after eight weeks 
greater positive changes than an equiva- 
lent control group on a self-sort, on a work 
adjustment scale, and after sixteen weeks 
on indices of work adjustment and success- 
ful outcome of hospitalization. Oddly 
enough, differences with respect to ward 
adjustment, psychiatric variables, and 
Group Rorschach performance were not sig- 
nificant. 

In the one study to date attempting to 
predict adjustment to transitional rehabili- 
tation programs Stotsky (16) found both re- 
cent and remote histories of alcoholism and 
a record of arrests to predict success or 
failure with high accuracy in one hospital 
setting. Unfortunately cross validation at 
a second hospital failed to support these 
findings at a satisfactory level of signifi- 
cance. A large battery of tests failed to 
predict at all. 

The hospital counselor has contributed 
little to research on the counseling process 
itself. Dibner (4) describes two measures 
of situational anxiety, as revealed in speech 
by verbal cues reflecting disorganization, 
emotional involvement, and defensiveness, 
which he used to study anxiety in psycho- 
logical interviews. In a somewhat differ- 
ent kind of study Stotsky (18) obtained the 
preferences of a predominantly lower class 
sample of NP patients for psychotherapy 
and other verbally oriented activities rela- 
tive to manual, recreational, and rehabili- 
tation activities. Not only did patients 


prefer the latter activities to “talking with 
the doctor about problems” but they re- 
garded psychotherapy as relatively less im- 
portant in helping to bring about their re- 
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Counseling Research in the Hospital Setting 


covery from mental illness. This wholesale 
rejection of verbal methods by lower class 
patients should lead to a review of coun- 
seling technique with an eye to drastic 
modifications to meet the needs of certain 
classes of patients. 


Future Research Possibilities 


No review of research in hospital coun- 
seling would be complete without some 
attempt to chart areas of possible future 
interest to the researcher. 

1. First of all, an assessment should be 
made of the relative predictive value in 
the hospital setting of the most widely 
used standard vocational tests. Are the 
norms appropriate? Do cutting scores dis- 
criminate between success and failure 
groups? Such work may very well lead 
to the abandonment of some of our pet 
tests and the. development of instruments 
which more accurately differentiate hos- 
pitalized patients into prognostic groups 
from a vocational standpoint. Attention 
needs to be given also to consensual defi- 
nition of adequate criteria of success and 
failure in both counseling and rehabilita- 
tion. Neither the patients’ pious hopes, as 
reflected in a positive self-picture, nor the 
therapists’ subjective judgments are com- 
pletely satisfactory. The so-called objec- 
tive criteria such as discharge or holding 
a job are not entirely adequate since so 
many factors affect them besides the vari- 
ables being measured. 

2. The counseling process in the hos- 
pital invites a programmatic investigation. 
Are there differences between hospital and 
clinic or between different types of hos- 
pital populations for such counseling di- 
mensions as structuring of the situation, 
directiveness vs. nondirectiveness, counsel- 
or-client relationship, expression of anxiety, 
client defensiveness, dependency-independ- 
ence, passivity-assertiveness, etc.P What 
is the effect of counseling on changes in 
the self-concept of physically and emo- 
tionally handicapped patients? What dif- 
ferences exist between hospital and clinic 
populations in their perception of the coun- 
selor, his role, and his importance? How 
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do social class and other sociological vari- 
ables influence the counseling process? 

3. The entire hospital milieu presents a 
research challenge. To what extent do staff 
and patient attitudes and interrelationships 
influence productivity and participation in 
rehabilitation activities? What forms of 
social organization, incentives, and _atti- 
tudes are most productive of positive re- 
sults? How do community attitudes and 
practices influence the outcome of treat- 
ment? What criteria can we develop for 
adequate selection of professional and oth- 
er personnel to work with patients? What 
are the major factors in the decision-mak- 
ing process with regard to selection of pro- 
grams of treatment for particular patients? 
What are the significant variables in inter- 
action among members of the treatment 
team? 

4. Finally, the patient himself—are there 
basic personality differences which are cru- 
cial in determining prognosis? There is 
also the interplay between disability and 
personality about which we know little. 
Does hospitalization bring about major 
personality changes? The hospital coun- 
selor, possibly more than anyone else, has 
a vital and enduring interest in discover- 
ing at least partial answers to these prob- 
lems. For him research must be interwoven 
into the fabric of his work. His very exist- 
ence as a therapeutic agent may well de- 
pend upon the solutions research provides. 


Received April 20, 1957. 
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Vocational Objectives for the 
Emotionally Disabled 


R. H. Johnson 
Minneapolis Public Schools 
C. H. Patterson 
University of Illinois 


The selection of appropriate vocational- 
occupational objectives or goals for the 
emotionally disabled constitutes a difficult 
problem in rehabilitation counseling. A 
number of factors contribute to the diffi- 
culty. They will only be mentioned brief- 
ly here, since they are being dealt with 
in detail elsewhere (Patterson, 3). 

There is first of all the problem of evalu- 
ating the aptitudes and abilities of the emo- 
tionally disabled. The general and perva- 
sive nature of the disability has rather 
general effects on aptitude and ability 
tests. Problems arise in the evaluation of 
test results, in terms of present functioning 
and potentiality, and in terms of the in- 
fluence of such factors as cooperation, mo- 
tivation and interest, set, and other general 
psychologi :al factors on specific perform- 
ance. Wha. are the chances that test per- 
formance will improve with improvement 
in these factors concomitant with recovery? 
Are there some deficits which are irreversi- 
ble? How can we best estimate the actual 
functioning of the client in a particular 
training program or job? Should we think 
in terms of the client's potentialities or in 
terms of his actual functioning? Should we 
consider objectives which he can easily 
achieve even at his present level of func- 
tioning, as is frequently recommended, or 
should we consider those which offer more 
of a challenge to his ability level? Little 
attention has been given to these problems; 
etl little information about them is avail- 
able, 

A second problem arises in the interpre- 
tation of interest tests and inventories with 


the emotionally disabled. There is con- 
siderable evidence that the emotionally 
disabled more frequently show interests in 
the talent occupations (art, literature, mu- 
sic) or in the social service field (Patter- 
son, 8), The former scales on the Kuder 
Preference Record have been designated as 
“escape” interests. These interests may in- 
dicate an aspiration for professional level 
occupations rather than the ific talent 
fields, but there is still the problem of 
whether this aspiration is consistent with 
ability levels. How much then can we de- 
pend on the vocational significance of the 
measured (or expressed) interests of the 
emotionally disabled, and how much do 
they represent the expression of psycho- 
logical conflicts and a desire to find an- 
swers to their problems, or a need for 
withdrawal, independence, freedom from 
restriction and routine, etc? 

A third problem area is that of the re- 
lation of personality characteristics to oc- 
cupations, As Super points out, “the convic- 
tion of their importance is strong and near- 
ly universal, but the evidence is virtually 
lacking and the means of measuring the 
characteristics are sadly defective” (Super, 
6, p. 483). If personality is important in 
vocational choice—over and above the fact 
that certain general personality character- 
istics are related to success in general—it 
is apparent that in the emotionally disabled 
its significance would be even greater. 
What are the personality requirements of 
various occupations? What are the occu- 
pationally significant personality character- 
istics of the emotionally disabled, either 
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as groups or as individuals? It is apparent 
that we do not have answers to these ques- 
tions. We have not yet discovered or de- 
veloped adequate measures of occupation- 
ally significant personality characteristics. 

To do effective vocational counseling 
with the emotionally disabled, we should 
have much more information in these prob- 
lem areas. But we cannot wait for such 
information to accumulate. We are faced 
daily with the problem of counseling the 
emotionally disabled. Are there then any 
data available to assist us in determining 
suitable occupational choices? It is pretty 
well established (Patterson, 2, 3) that the 
emotionally disabled are in general less 
successful than the physically disabled in 
the vocational rehabilitation process. But 
are there some fields of work in which 
they are more likely to be successful than 
in others? Are there some occupations 
which perhaps should be avoided because 
of the small possibility of success? Are there 
any empirical data in this field which may 
be helpful pending answers to the prob- 
lems raised above? It is recognized that the 
great heterogeneity of the emotionally dis- 
abled will limit the finding and usefulness 
of any general guides. Analysis by diagnos- 
tic categories will probably be of little 
value because of the variability within each 
category. But as a first approximation pos- 
sibly some useful information could be ob- 
tained from the analysis of the relative 
success of the emotionally disabled in vari- 
ous types of work and various occupations. 

A search for such data discloses prac- 
tically nothing. Several studies indicate 
that the emotionally disabled are em- 
ployed, apparently successfully, in almost 
every occupation (Rennie, 4 and Sprol, 5). 
Records of the Veterans Administration 
show that emotionally disabled veterans 
have been entered into training for every 
occupation in which the physically dis- 
abled have trained. Opinions are frequent- 
ly given regarding types of work or jobs 
which the emotionally disabled should 
avoid, but no evidence supporting them 
is available. On the positive side the au- 
thors are aware of no specific recommen- 
dations or opinions. There is one sugges- 
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tion by White (7) that woodworking is 
a particularly suitable occupation, on the 
basis of workshop experience with a small 
group of the emotionally disabled. 


In a study by the senior author (1), the 
nature of the disability was found to be 
related to success in the training of motor 
vehicle mechanics. The neuropsychiatri- 
cally disabled veterans were least successful 
in training in a program of school followed 
by on-the-job training; 18 per cent of the 
neuropsychiatrically disabled were success- 
ful, compared to 44 per cent of the total 
group (N=51). In an on-the-job only train- 
ing program, the neuropsychiatrically dis- 
abled were successful in 47 per cent of the 
cases (N=91) compared to 60 per cent of 
the total group. Within the neuropsychia- 
tric group not a single veteran with the 
diagnosis of psychosis was _ successful 
(N=20). There was very little difference 
among the remaining categories, including 
psychoneuroses and neurological disorders. 
The difference between the rates of success 
for those in the two types of training pro- 
grams may be due to the more severely dis- 
abled entering the school-on-the-job pro- 
gram because of being able to gain admit- 
tance to a school easier than being accepted 
for on-the-job training. 

These results led to a study to determine 
if there were differential rates of success 
of the neuropsychiatrically disabled, com- 
pared to the physically disabled, in various 
occupations. Because of the apparent dif- 
ference between those diagnosed -as psy- 
chotic and those diagnosed as psychoneu- 
rotic, these two groups were treated sepa- 
rately. 

Data on all male, white, disabled vet- 
erans who had entered training under Pub- 
lic Law 16 in Minnesota from the begin- 
ning of the program in 1948, and who had 
by September of 1951 dropped out of 
training or had been classified as rehabili- 
tated, were collected. The sample included 
811 diagnosed as psychotics, 1,676 diag- 
nosed as psychoneurotics, and 10,672 with 
non-neuropsychiatric disabilities. To be 
classified as successful (rehabilitated) 4 
veteran had to have completed the training 
program and/or have been found employed 
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in the occupation for which he had been 
taining, or a closely related one, six 
months after completing or dropping out 
of training. 

All veterans had been approved for a 
particular training program only after vo- 
cational counseling by VA counselors. Be- 
fore a comparison of success ratios by oc- 
cupation can be interpreted, it is necessary 
to know whether the counselors controlled 
the distribution of trainees among the oc- 
cupations differentially for the neuropsy- 
chiatrically and the non-neuropsychiatri- 
cally disabled. A comparison of the dis- 
tributions of the two groups among 39 dif- 
ferent occupations and a miscellaneous 
group indicated that there was no differ- 
ence. Therefore, veterans with neuropsy- 
chiatric disabilities did not choose, nor 
were not directed into, any occupation 
more frequently than the non-neuropsy- 
chiatrically disabled. 

Table 1 shows the relative over-all suc- 
cess ratios of the three groups studied. 
These results are similar to those of other 
studies (Patterson, 2, 8). Table 2 gives the 
telative success ratios by major occupation- 
al groups. It appears that while there are 
no differences in the success ratios for pro- 
fessional occupations, in the semiprofes- 
sional occupations the psychotics are less 
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successful than the psychoneurotics or the 
non-neuropsychiatrically disabled. In the 
clerical occupations the psychotics are less 
successful than the non-neuropsychiatric 
group, but not significantly less successful 
than the psychoneurotics. For the skilled 
trades, the psychotics were less successful 
than the psychoneurotics, who in turn were 
less successful than the non-neuropsychia- 
tric group. No conclusions can be drawn 
about the semiskilled and unskilled, even 
though only one of the psychotics was sc- 
cessful at this level. The nature of the pro- 
gram, involving extended training, meant 
that relatively few cases would be classi- 
fied in these categories. 


Table 1 


Percentage of Success in Training of Dis- 
abled World War II Veterans by 
Selected Disability Category 


Number of % 
Trainees Rehabilitated 





Disability Category 











Psychotics in Remission 811 89 

Psychoneurotics 1676 56 

Non-neuropsychiatric 10672 62 

Total 12659 61 
Note: (a) {ll Gttepanses are significant at the .01 
(b) The combined tion of neuropsychia- 
veterans had a success 


ratio of 53 per cent, 


Table 2 


Percentage of Success in Training of Disabled World War II Veterans 
by Occupational Groups and Selected Disability Category 














(a) (b) (c) 
Non- 
Occupational Psychotics Psychoneurotics neuropsychiatrics 
Category N % N % N % 
Professional 50 56 245 66 2008 69 
Semiprofessional* 82 25 116 51 725 55 
Managerial 29 55 192 57 1457 65 
Clericalt 45 83 106 46 621 55 
Sales 12 42 108 55 679 59 
Service 10 50 83 52 150 61 
Agricultural 23 57 199 73 1260 72 
Skilled+ 100 80 622 50 8519 59 
Semiskilled & Unskilled 10 10 55 38 253 48 
Total 811 1676 10672 





*The differences between a and b and a and ¢ are significant at the .01 level. 
+The differences between a and c are significant at the .01 level. 
tThe differences between all categories are significant at the .01 level. 
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Table $3 reports the analysis by 34 sepa- 
rate occupations, plus two miscellaneous 
groups. 

The small numbers of veterans with a 
psychotic diagnosis in many of the occupa- 
tions precludes many statistical compari- 
sons for this group. However, analysis of 
those occupations including nine or more 
cases indicates that veterans with a psy- 
chotic diagnosis are less successful pl 
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the non-neuropsychiatrically disabled jn 
training in drafting, in motor mechanics, in 
other mechanical occupations, in other o¢. 
cupations not elsewhere classified (all at 
the .01 level), and as. commercial 
bookkeepers, and semiskilled workers (.05 
level). 

Veterans with a psychoneurotic diagnosis 
are less successful as trainees in motor 
mechanics (.01 level), retail managers 


Table 8 
Percentage of Success in Training 12,659 Disabled World War II 














Veterans by Selected Occupations and Disability Category 
Psycho- Non-neuro- 
Three Digit Psychotics neurotics psychiatrics 
Occupation Title D.O.T. Code N % N % N % 
Accountants 0-01 8 75 47 51 400 61 
Reporters 0-06 4 75 17 65 93 69 
Engineers 0-7, 15-21 10 40 4) 59 456 61 
Lawyers 0-22 8 67 18 77 79 68 
Social Workers 0-27 1 00 12 67 51 80 
Teachers 0-11, 0-24, 0-30-33 14 64 66 83 506 15 
Personnel Workers 0-39 “ 50 19 68 168 vc} 
Commercial Artists* 0-44 18 28 21 48 181 58 
Draftsmen**xx 0-48 9 00 23 52 210 41 
Retail Managerst 0-72 4 50 51 53 425 67 
Jr. Executives 0-97, 98-99 22 55 107 55 822 68 
Bookkeepers* 1-01 14 21 47 43 281 55 
Stock Clerks 1-38 & 25 10 70 78 62 
Sales, Insurance ae ; a 20 65 62 56 
Sdlespersins 1-7 27 59 172 68 
Sales, Consumers 1-80 4 75 40 88 215 of 
Sales, Wholesale 1-85, 86, 87, 88 8 00 17 76 178 65 
Cooks 2-26 4 50 16 88 62 40 
Barbers 2-82 5 60 14 64 72 vf 
Farmers 8-01-09 20 65 184 76 1,215 78 
Bakerst 4-01 4 00 16 25 75 59 
Cabinet Makers 4-32 1 100 26 69 120 60 
Upholstererst 4-35 7 29 22 23 86 48 
Printers 4-44-50 1l 82 89 62, 196 70 
Shoemakerst 4-60 :§ 14 80 27 106 52 
Watchmakers 4-71 8 00 15 80 142 68 
Machinists 4-75-76 2 00 22 86 177 51 
Sheet Metal 4-80 2 50 15 60 82 68 
Electricians 4-97 5 60 83 55 201 68 
Carpenters 5-25 4 50 80 78 202 66 
Plumbers 5-30 0 00 18 67 98 71 
Meatcutters 5-58 0 00 ll 55 81 74 
Mechanic, Motor**+xx 5-81 20 00 122 43 610 59 
Mechanic, Other**x 5-83 18 22 120 48 672 52 
Semiskilled* 6-8 9 1l 51 41 220 55 
Other Occupation N.E.C.**x 68 40 814 54 1,983 58 
Total 811 89 1,676 56 10,672 62 
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bakers, upholsterers, and shoemakers (.05 
level). Those with a psychotic diagnosis 
are less successful than those with a psy- 
choneurotic diagnosis as trainees for drafts- 
men, motor mechanics (.01 level), and in 
other mechanical occupations and other 
occupations N.E.C. (.05 level). 


The results are thus relatively meager. 
Because of the number of tests of signifi- 
cance, some of the findings could be due 
to the operation of chance factors. Many of 
the differences reported as significant at 
the .05 level are, however, actually at the 
02 level. Definite interpretations or con- 
dusions are not warranted. Larger numbers 
in the groups, if the percentage successful 
remained the same, would no doubt pro- 
duce more significant differences. 

Several tentative suggestions may be 
made. 

1. There seems to be no support for the 
concept that the emotionally disabled 
should be limited to the lower level occu- 
pations, that they should avoid profession- 
al occupations. Although less successful 
than the non-neuropsychiatrically disabled 
(though not significantly so) the psychot- 
ics are more often successful in profession- 
al occupations than in some other fields. 
In managerial and agricultural occupations 
they are also relatively successful. The 
psychoneurotics also are relatively success- 
ful in these fields. This suggestion is de- 
pendent on the expectation that the suc- 
cess ratios for professional and managerial 
trainees will be similar following place- 
ment on the job. Trainee situations for 
some semiprofessional and skilled trade 
occupations may be more akin to the com- 
petitive job situation than is true for the 
trainee situations for the professions. 


2. The types of jobs in which psychotics 
are relatively unsuccessful suggest that 
perhaps they should avoid skilled and semi- 
skilled trades. What the particular aspects 
of this work are which are unfavorable, 
whether it is the heavy, greasy, “dirty” na- 


<a | ture of the work, is not clear. There is some 
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suggestion that perhaps detail work should 
be avoided (e.g. bookkeeping, commercial 
art, drafting). 
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8. Psychoneurotics, while perhaps not be- 
ing particularly suited to the trades, appar- 
ently are not unsuited to detail work. Their 
relative lack of success as retail managers, 
bakers, upholsterers, and shoemakers may 
indicate some problems in functioning in 
close contact with a few people, or in small 
business contacts with customers, 

These suggestive results appear to be 
consistent with the measured vocational in- 
terests of the emotionally disabled. In addi- 
tion to more frequently having professional 
level interests, the emotionally disabled 
have been found to manifest little interest 
in the mechanical and scientific (techni- 
cal) areas. However, there appears to be 
some disagreement, in the case of the psy- 
choneurotics, with the finding that the 
emotionally disabled, including psychoneu- 
rotics, tend to be low on the clerical and 
computational scales of the Kuder ( Patter- 
son, 3). However, it should be noted that 
although the differences did not reach sig- 
nificance, the psychoneurotics are less suc- 
cessful than the non-neuropsychiatrically 
disabled in the clerical field and the cleri- 
cal occupations (accounting, bookkeep- 
ing). 


Summary 

The problem of whether some occupa- 
tions are more suitable than others for 
the emotionally disabled is considered. 
There is virtually no research available on 
this problem. As a beginning, the results 
of a comparison between 311 veterans diag- 
nosed as psychotic, 1,676 diagnosed as psy- 
choneurotic, and 10,672 with non-psychiat- 
ric disabilities are reported. The psychotics 
appear to be relatively less successful in 
the clerical field and in the trades, both 
skilled and unskilled. Psychoneurotics are 
apparently less successful in the trades 
also. There is no support for the idea that 
the emotionally disabled are not likely to 
be successful in the professional occupa- 
tions, though the technical occupations are 
apparently somewhat less suitable. The re- 
sults are suggestive enough to indicate the 
desirability of further study. A survey on 
a national level would include sufficient 
numbers in each occupation, and might 





296 R. H. Johnson and C. H. Patterson 


even make possible some breakdown with- 
in the psychotic and psychoneurotic cate- 
gories. 

Received August 22, 1956. 
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Level of Affect in the Counseling Responses 
of High School Senior Boys 


James S. Weeks* 
Eastern Michigan College 


The classification of clients’ problems has 
received considerable attention in counsel- 
ing literature. There appear to be at least 
two needs that such a classification fills. 
One is to enable the counselor to under- 
stand the client and his problems better by 
providing a frame of reference. Another 
is to facilitate the grouping of different 
interviews, discussion units, or other seg- 
ments of counseling for research purposes. 

Williamson (8) has proposed one method 
of classifying clients’ problems based on the 
context of the problem. He included the 


_| categories of personality problems, educa- 


tional problems, vocational problems, finan- 
cial problems and health problems. Dipboye 
(3), in using this classification scheme to 
study differences in counselor style, con- 
cluded that these categories tended to di- 
vide themselves into two groups which he 
labeled “affective” and “cognitive.” Many of 
the differences he observed in counselor 
style appeared to be related to membership 
of discussion units in these two larger 
groups, but within these two groups the 
system did not differentiate counselor style 
adequately. Bordin (1, p. 188) and others 
have criticized this system of classifying 
problems as being overlapping and leaving 
something to be desired in the understand- 
ing of clients. It would seem to this writer 
that similar criticism could be raised against 
any other system which is based on the 
content of the clients’ responses. 





1This study was part of a doctoral dissertation 
() completed in 1955 at Syracuse University under 
sponsorship of Claude W. Grant. The author 
was on the staff of the University of Buffalo at 
the time the manuscript was submitted. Ed. 


The Present Study 


In an attempt to overcome some of the 
weaknesses pointed out above, this writer 
used a system of classifying clients’ re- 
sponses according to the intensity of feel- 
ing they expressed. To accomplish this 
classification system, the level of affect, de- 
fined as the intensity with which the client 
expressed his feelings, attitudes, interests, 
values, etc., was proposed as a variable 
dimension of the discussion unit. The 
cific method of measuring the level of affect 
will be described below in the section on 
method. In addition to developing and 
measuring this variable, its relationships to 
two other counseling variables were stud- 
ied. 

One relationship studied was that be- 
tween level of affect and talk ratio. It was 
thought that if the level of affect, as meas- 
ured, did reflect the client’s involvement 
in the discussion topic, he would tend to 
play a more active role when expressing 
higher levels of affect. The following hy- 
pothesis was therefore proposed: there will 
be a positive relationship een level of 
affect and talk ratio in discussion units of 
counseling interviews. 

The relationship between the level of af- 
fect and counselor style was also studied. 
If it was to be of value in counseling re- 
search, then changes in the level of affect 
— by clients should be accompan- 
ied by changes in other significant aspects 
of counseling. Counselor style was selected 
to be studied because it has been shown 
(2, $3) to vary with variations in other di- 
mensions of client behavior. It was 
that changes in level of affect d also 
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be accompanied by changes in counselor 
style. Therefore, the second hypothesis was 
proposed as follows: there will be differ- 
ences in counselor style in discussion units 
where clients express different levels of 
affect. 


The Sample 


The clients whose interviews yielded 
the data for this study were 20 senior boys 
from two high schools in the vicinity of 
Syracuse, New York. These boys had in- 
dicated a desire for counseling to their 
high school guidance counselors, and were 
referred to the Psychological Research Cen- 
ter of Syracuse University to participate in 
this study. They were advised that the 
interviews would be recorded for research 
purposes. They were told that the purpose 
of counseling was to help them with their 
post high school planning, but that they 
could also discuss any other matter they 
wished with the counselor. A total of 87 
interviews were held, ranging from 15 min- 
utes to 2 hours in length. 

High school senior boys were used in 
this study for several reasons. Counseling 
with this age and educational group may 
pose different problems from those posed 
by counseling with older and more educa- 
tionally advanced groups, and the intro- 
duction of counseling services into high 
schools has made high school students po- 
tentially our largest single source of clients. 
Also, if the findings of this study could be 
related to previous findings, which have 
been based mostly on counseling with col- 
lege students and adult clients, they might 
furnish some basis for safer generalization 
of the principles involved to a broader 
range of clients than was previously feas- 
ible. 


Method 


The rating method. The counseling inter- 
views were recorded and typescripts were 
made from the recordings. The typescripts 
were divided into discussion units, consist- 
ing of all consecutive client and counselor 
responses that pertained to a single topic 
of discussion, as suggested by Robinson 
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(5). Each discussion unit was then rated 
for level of affect. Since the intensity with 
which a client expresses his feelings, ete, 
might change from response to response, 
it was decided that each response would be 
rated separately, and the mean rating of 
the responses in each unit would be the in- 
dex of the level of affect in the unit. 

In rating each response the rater listened 
to the recorded interview, and at the same 
time read the typescript. Listening to the 
interview permitted the rater to consider 
changes in inflection, tonal changes, hesita- 
tions, and other variations in the client's 
speech which would not be available from 
the typescripts alone. Reading the type 
scripts at the same time made it easier to 
follow the content of the interview, to iden- 
tify the speaker, and to differentiate sep- 
arate responses for rating. 

For the purpose of rating, one client re 
sponse was defined as all uninterrupted 
client talk which conveyed one thought. It 
could be recognized as all client talk occur- 
ing between two counselor speeches, be- 
tween a counselor speech and a period of 
silence, or between two periods of silence, 
except where a long uninterrupted client 
speech contained more than one idea. In 
these instances each complete idea ex 
pressed by the client would be considered 
as a separate response, and would receive 
a separate affect rating. 

The ratings ranged on a five-point scale 
with the rating of one signifying a very low 
level of affect. The rating was based on 
the intensity of expression, which was ob 
servable from the recordings, and also on 
the extent to which the response communi- 
cated feeling vs. factual information. The 
following are descriptions which were used 
to help in identifying reference points along 
the continuum of level of affect. 

For a rating of 1, or very low: 

“This rating will apply to responses which 
are primarily factual and communicate 
very little or no recognizable feeling.” Ex 
amples of responses receiving this rating 
are: 

“I’m taking a business course in school.” 

“Yes, I took that test.” 
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Counseling Responses of High School Senior Boys 


For a rating of 2, or low: 

“This rating will apply to the responses 
which convey primarily factual material, 
but which contain a definitely recognizable 
element of affect which is expressed with 
little intensity.” Examples of responses re- 
ceiving this rating are: 

“That last test was pretty interesting.” 

“I like to do things, I like to study, to 
work some, fishing, sports, play basketball, 
stuff like that.” 

For a rating of 8, or moderate: 

“This rating will apply to responses 
which convey factual material and affec- 
tive material approximately equally, or re- 
sponses which indicate moderately intense 
feeling.” 

Although the assigning of ratings of three 
or higher are as dependent upon the man- 
ner in which the response is made as on 
the content of the response, examples of 
responses receiving these higher ratings are 
included. Examples of responses receiving 
a rating of three are: “Look at all my in- 
terests. I can certainly read. I can sit down 
and read a whole book in one night.” “But 
I don’t know, I just want to make some- 
thing of myself.” 

For a rating of 4, or high: 

“This rating will apply to the responses 
which are primarily meant to convey affect. 
They may contain some information related 
to the topic of discussion but their basic 
purpose is to convey the client's feelings. 
Examples of responses receiving this rating 
are: 

“He’s just about the best teacher I’ve 
Tun across.” 

“Sometimes it gets you a little mad. My 
stepfather does just the opposite of when 
youre trying to help.” 

For a rating of five or very high: 

“This rating will apply to the responses 
which communicate very intense affect and 
contain very little or no information re- 
garding the topic of discussion, They will 
usually be stated with strong emphasis and 
may include swear words, or speech dis- 
turbances such as hesitation, stammering, 
etc.” Examples of responses receiving this 
tating of five are: 
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“I don’t see why he has to yell at her, 
she’s a damn nice girl.” 

“The hell with him!” 

Reliability of ratings. Since the ratings 
of affect are primarily subjective ratings, 
it is necessary to determine their inter-rater 
reliability. To investigate this, the following 
procedures were employed. 

A pre-rating training meeting was held 
during which three raters? who were 
trained counselors came to agreement on 
the rating system. Then portions of re- 
corded interviews (not a part of the data 
of the study) were played and the raters 
discussed the rating of the client responses 
in these portions. This was continued until 
the raters were in agreement as to the rat- 
ing a response should get. Next a prelim- 
inary rating session was held, using the re- 
cordings and typescripts of counseling inter- 
views. During this session short sections 
of typescripts were rated, and comparisons 
of the ratings were made. Any gross dif- 
ferences (two or more points) were dis- 
cussed and where necessary, the record- 
ing was replayed to identify the source of 
those differences, At the conclusion of this 
session there appeared to be a considerable 
amount of agreement between the ratings 
of the three raters. 

At the following meeting the raters pro- 
ceeded to independently rate four inter- 
views from the study, and the results of 
these ratings were compared for raters’ 
agreement. 

Comparisons of all the combinations of 
pairs of raters revealed either perfect or 
very close agreement in ratings for most 
of the responses. In addition to close gen- 
eral agreement, there were no specific in- 
stances of complete contradiction in the 
ratings of different raters. 

To test the statistical significance of 
agreement among raters the following pro- 
cedure was employed. Using the distribu- 
tion of theoretical frequencies of chance 
disagreements in ratings on a five-point 





2The training and qualification of these raters 
is described in detail in the doctoral dissertation 
from which this report is taken. (7) 
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scale,’ chi-square was computed to test the 
null hypothesis that: “The disagreement 
scores between the pairs of judges are ran- 
dom samples from the population of chance 
disagreements on a five-point scale.” The 
resulting chi-square values ranged from 
166.3 to 309.0 for pairs of raters, and was 
638.9 for all pairs combined. For four de- 
grees of freedom a chi-square value of 
18.46 has a probability of occurring by 
chance of .001. It is apparent that these 
raters agreed far better than could be ex- 
pected by chance alone. From these data it 
appears reasonable to conclude that the 
level of affect expressed in client responses 
can be rated on a scale such as this with 
a satisfactory degree of agreement by 
trained raters. 

Since the level of affect of the discussion 
unit was the measure to be used in the 
study, it was also necessary to determine 
its interrater reliability. To do this a sep- 
arate level of affect score was determined 
for each discussion unit by computing the 
mean of the ratings of each rater. These 
means were then correlated for each com- 
bination of pairs of raters, producing pro- 
duct-moment correlation coefficients rang- 
ing from .91 to .94, all of which are signif- 
icant beyond the .01 level of confidence. It 
was concluded, therefore, that the level of 
affect in discussion units can be deter- 
mined with a satisfactory degree of rater 
agreement. 

Analysis. After determining that the level 
of affect could be rated reliably by inde- 
pendent raters, its value was determined 
for each discussion unit in the recorded 
interviews using this method. In addition, 
talk ratio and counselor style were deter- 





8This distribution was obtained by considering 
the possible combinations of ratings which could 
be obtained by chance alone. Thus, 5 combinations 
(lx 1,2x2,3x 8, 4x 4,5 x 5) could produce 
perfect agreement, 4 combinations (1 x 2, 2 x 8, 
8 x 4, 4 x 5) could produce disagreement by two 
points, 2 combinations (1 x 4, 2 x 5) could pro- 
duce disagreement by $8 points, and only one 
combination (1 x 5) could produce disagreement 
by 4 points. In terms of percentages this distribu- 
tion becomes: “0” = 33%, “1” = 27%, “2” = 
20%, “3” = 18%, “4” = 7%. 
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mined for each discussion unit. The index 
of talk ratio was defined by the fraction; 
client talk / total talk, using the halfline 
of typescript as the unit of measure for 
talk. Counselor style was determined by 
using a modification of the method of de. 
scribing style devised by Seeman (6). All 
short discussion units were omitted since 
it was felt that their classification would be 
less reliable. Only discussion units contain- 
ing 20 or more client responses, or 40 or 
more total responses, were included in the 
analysis. There was a total of 89 such units, 


Results 


To test the first hypothesis, the product- 
moment correlation coefficient was com- 
puted between level of affect and tak 
ratio for all discussion units. The value ob- 
tained was r = .57 which is significant be 
yond the .001 level of confidence. Because 
the appearance of the distribution of 
these two variables suggested that a curvi- 
linear relationship existed between them, 
the correlation ratio was also computed. 
The value obtained was Eta = .65 which is 
also significant beyond the .001 level of 
confidence. 

At this point a question arose about the 
source of this relationship. It appeared to 
be possible that the relationship might be 
caused entirely by differences in the man- 
ner of response of different clients, and 
that in truth no significant relationship 
existed between the two variables within 
the discussion unit of the individual client, 
It would have been desirable to correlate 
these variables for each client separately; 
however, it was impossible to do this in 
any meaningful fashion since only four 
clients had produced more than five dis- 


cussion units, In an attempt to estimate } 


the within-client relationship that existed, 
the following procedure was used. 

The mean and standard deviation of talk 
ratios of all the discussion units of a client 
were computed separately for each client. 
The talk ratio for each discussion unit of 
a client was then expressed as a z-score 
based upon the individual client’s own 
mean and standard deviation. In this man 
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ner the mean talk ratio, and the variability 
in talk ratio of all clients were equated and 
in effect, the between-clients variance was 
removed. 

The level of affect scores of the discus- 
sion units of each client was converted to 
wscores by the same method. The z-scores 
of level of affect and talk ratio for all 
clients were then correlated. This yielded 
the value of r = .47 which for an N of 89 
is significant beyond the .001 level. This 
relationship appeared to be linear. Since 
the level of affect of differences between 
clients had been removed, this correlation 
can be interpreted as describing the de- 
gree of relationship that exists between the 
level of affect and talk ratio within clients. 
It appears to be safe to conclude there- 
fore, that there is a significant relationship 
between these two variables within the dis- 
cussion units of the individual clients. 

To test the second hypothesis, the discus- 
sion units were combined into three groups 
based on their level of affect. These groups 
were labeled high-affect, moderate-affect, 
and low-affect units. Table 1 presents the 
mean, standard deviation, and number of 
discussion units included in each group. 
Counselor styles were then combined for 
all discussion units at each level of affect, 
thus giving a composite picture of the coun- 
selor’s style. Table 2 presents the combined 
style for high-affect, moderate-affect, and 
low-affect discussion units. 

A number of differences in the counselor 
style can be observed from Table 2. For 
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Table 1 


Level of Affect Scores of Discussion Units 
Classified as High-affect, Moderate-affect, 








and Low-affect 
Classification N Mean S.D. 
High 8 2.72 0.34 
Moderate 20 1.83 0.18 
Low 61 1.87 0.18 





example, in the high-affect units, seven of 
the nine types of counselor response have 
proportions of frequency of use above .100, 
whereas only four types of responses in the 
low-affect units have proportions above 
this figure. This suggests that a wider var- 
iety of types of response were used by the 
counselor when the clients were expressing 
higher levels of affect. Another difference 
between counselor styles for four different 
levels of affect is the relatively higher fre- 
quency for use of category 1B in high-affect 
discussion units, An inspection of the con- 
tent of these responses indicates that many 
of them were semi-interpretive responses, 
posed in the form of general lead questions, 
a technique which was consistently used by 
the counselor in all types of discussion 
units, but used more frequently in high- 
affect units. Still another difference noted 
is that the relative frequency of use of this 
type of response bears an inverse relation- 
ship to the level of affect of the discussion 
units. 

Certain similarities in counselor style can 
also be seen in Table 2; for example, cate- 
gories 8B, interpretation of feeling, and 


Table 2 


Counselor Styles for High-affect, Moderate-affect, and 
Low-affect Discussion Units 





Level 








of Type of Counselor Response 

Affect iA 6 6B 6 CSAC USB CSA. SB UA CS 6 
Proportion of frequency of use 

High 101 .179 .126 .108 .147 .046 .018 .107 .166 

Moderate 189 .072 .115 .068 .0938 .020 .021 251 218 

Low 176 .088 .088 .024 .096 .011 .081 .412 .079 
Rank order of frequency of use 

High 7 1 4, 6 8 8 9 5 2 

Moderate 8 6 4 7 5 9 8 1 2 

Low 2 4 5 8 8 9 7 1 6 
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4A, counselor giving advice or making de- 
cisions for the client, were used relatively 
little in discussion units at all levels of 
affect. 

A method of making an over-all compari- 
son of counselor style between different 
groups of discussion units which was de- 
veloped by Seeman, (6) consists of con- 
verting the proportions of frequency of 
use to rank orders of relative frequency 
of use, with the largest proportions being 
given the rank of one, etc. This ranking of 
the data makes it possible to test the de- 
gree of relationship between the counselor 
styles in the three groups of discussion 
units. As an over-all test, Kendall’s Co- 
efficient of Concordance (4) was com- 
puted, yielding the value of W = .69 which 
is significant at the .01 level of confidence. 
It appears to be safe to conclude therefore, 
that although there were notable differ- 
ences between counselor styles in discus- 
sion units with different levels of affect, 
there were also significant similarities, 

A further analysis of the relationship be- 
tween counselor styles in these different 
groups of units was accomplished by com- 
puting rank correlations between counselor 
styles for pairs of groups. Kendall’s Tau 
was used as the index of correlation since 
its significance is readily testable with 
samples of this size. Table 3 presents the 
rank correlations obtained from this an- 
alysis. From Table 8 it can be seen that 


Table 3 


Rank Correlations Between Counselor Styles in 
High-affect, Moderate-affect, and Low-affect 
Discussion Units 








Level of 

Affect High Moderate Low 
Moderate .28 

Low 22, .61* 





*Significant at the .05 level of confidence. 


only the correlation between moderate- 
affect and low-affect units was significant. 

From these data it appears that counselor 
style was quite similar in discussion units 
with moderate and low level of affect, but 
that in discussion units with a high level of 
affect the counselor’s style differed. It is 
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also apparent that there is an over-all con- 
sistency in counselor style as evidenced by 
a constant preference for certain types of 
responses and an avoidance of others re. 
gardless of the level of affect being ex. 
pressed by the client. This finding that the 
counselor maintains a consistent style with 
moderate variations corresponding to 
changes in client behavior, is consistent with 
findings by Danskin and Robinson (2), 
Dipboye (8), Seeman (6), and others 
where counselor behavior was studied in 
relation to other aspects of the counseling 


interview. 
Summary and Implications 


The purpose of this study was to inves- 
tigate the possibility of directly measuring 
the intensity of feeling expressed by the 
client, referred to as the level of affect, as 
one dimension of client behavior which 
might be useful in studying counseling re- 
lationships. The relationship of the level of 
affect to two such variables, talk ratio and 
counselor style, was studied. 

The method consisted of listening to re- 
corded counseling interviews while follow- 
ing typescripts of them, and rating each 
client response on a five-point scale of ex- 
pressed affect. The mean of the ratings of 
responses in a discussion unit was used as 
the index of the level of affect for the 
discussion unit. Correlations between rat- 
ings of independent raters ranging from 
.91 to .94 were obtained, all significant be- 
yond the .01 level. 

Thirty-seven interviews with 20 high 
school senior boys were analyzed using this 
variable. The interviews were divided into 
discussion units and it was found that the 
level of affect was significantly related to 
the talk ratio units. It was also found that 
although counselor style had an over-all 
consistency, in discussion units which could 
be classified as high-affect units, it differed 
significantly from the style used by the 
counselor in other discussion units. . 

Although it is very likely that counselors 
have been responding to level of affect for 
a long time, there is value in identifying 
it as a specific dimension of client re- 
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sponses, because this may increase the 
counselor’s sensitivity to it, as well as to 
make more feasible the teaching of this sen- 
sitivity to beginning counselors. 

The fruitfulness of the level of affect as 
a means of classifying discussion units for 
research purposes has been demonstrated 
by the two relationships discussed in this 
report. The use of ratings from sound re- 
cordings of counseling interviews rather 
than merely from typescripts, as has been 
the usual practice, would insure that the 
rater was getting at what the client was 
commmunicating to the counselor much 
more accurately than could be possible 
from the typescripts alone. 

Received May 5, 1957. 
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The Development of an Instrument for the 


Measurement of Counseling Perceptions 


Dugald S. Arbuckle 
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One of the most important and basic 
aspects of counselor preparation is the de- 
velopment of counseling perception. This 
may be described as the ability to discern 
different client attitudes in different situa- 
tions. The purpose of the study being re- 
ported here was the development and 
evaluation of a free-response instrument 
measuring counseling perception. More 
specifically, it was concerned with the de- 
velopment of an appraisal instrument that 
would provide a more objective compari- 
son between the counseling perception of 
counselor-trainees and a jury of expert 
counselors. 


Procedure 


Source of the test items. The material 
content of the client statements that made 
up the test items was drawn from type- 
scripts of counseling sessions with clients. 
The typescripts were taken from the coun- 
seling data of eight different clients under- 
going therapy with counselors functioning 
in college, social work, clinic and private 
practice settings. 

Construction of test items. The construc- 
tion of the test items involved a rather in- 
tensive analysis of the typescripts in order 
to select particularly emotionalized expres- 
sions of the client. The statements were 
regarded as being a fairly representative 
cross-section of the verbalizations presented 
by the clients during the therapeutic hour. 
Represented in the series were a variety of 
complaints and expressions of feelings and 
attitudes regarding homosexuality, incest, 
fears of childbirth, parent-child relation- 
ships, teacher-student relationships, boy- 


girl relationships and peer relationships, 
Ninety-four crude test items were devel- 
oped, consisting of a paragraph of client 
talk, followed by a short counselor re 
sponse, a second continuing paragraph of 
client talk, followed by an open end; that 
is, the second counselor response was left 
blank. This open-end was the point where 
the trainee would make his response to 
the client talk. These crude test items 
were then distributed to the committee 
of expert counselors for the elicitation of 
their responses. 

The criterion committee. Since the train- 
ing device was aimed at the measurement 
of counseling perception skill, especially 
its accuracy in a given situation, the most 
obvious source for the criterion of coun- 
seling perception in that same given situa- 
tion was the demonstration and exercise 
of such skill by expert counselors. It was 
assumed ‘that the skilled and successful 
therapist was better versed in the theory 
and the methodology of counseling. The 
number of clients who have been helped 
to achieve a more satisfactory adjustment 
to living would tend to validate the thera- 
peutic procedures used by the committee 
of expert counselors. 

There is evidence to indicate that expert- 
ness in counseling is a function of success- 
ful practice, and there is a distinguishable 
difference between the counseling tech- 
niques of the experienced and the inex- 
perienced counselor. A study by Fiedler 
(1) indicated that better trained thera- 
pists of different schools agreed more high- 
ly with each other than they agreed with 
less well-trained therapists within their 
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own school, and that the therapeutic rela- 
tionship created by experts of one school 


resembles more closely that created by ex- 


perts of other schools than it resembles 
relationships created by nonexperts within 
the same school. 

In a study conducted by Strupp (2) in 
which comparisons were made between 
the practices of experienced and inexper- 
ienced psychiatrists, psychologists, and psy- 
chiatric social workers, it was found that 
the techniques that are most popular among 
the inexperienced therapists tend to under- 
go a decline as the therapist becomes more 
experienced. 

To arrive at the identification of counsel- 
ing perception in a given situation—i.e., 
the test item—the procedure followed was 
to present the ont test items to the ex- 

counselors and have them respond to 
the situation represented by each test item. 
The responses of the experts were sub- 
mitted to a screening procedure wherein 
items were isolated which were distin- 
guished by the fact that a number of the 
expert counselors responded in a similar 
way. These items in which the experts gave 
responses which were similar were retained 
as criterion items to be used for the pur- 
pose of comparing the responses of the 
trainees with the responses of the experts. 
Those test items which drew from the ex- 
perts a wide range and variety of responses 
were discarded as having no value as cri- 
terion items, 


Seventy-four counselors (coun- 
selor trainers, professors of guidance, di- 
rectors of guidance or personnel, directors 
of counseling or testing, or counseling Ee 
chologists) were contacted regarding their 
serving on the criterion committee. Of 
these, 42 replied, indicating they would 
or would not serve on the committee. 
Twenty-seven individuals indicated that 
they would serve on the committee, but 
22 were all who completed the work re- 
quired of the committee members. These 
22 received their doctorate training at 11 
different institutions—the University of Chi- 
cago, Columbia University, Harvard Uni- 
versity, Indiana University, the University 
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of Minnesota, the University of Buffalo, 
the University of Michigan, Oregon State 
Coilege, the Ohio State University, Brown 
University and George Washington Uni- 
versity. 

The second phase of the work of the 
committee members was to study the col- 
lected responses and to determine whether, 
in their judgment, the block of responses 
to a particular item were or were not simi- 
lar. Having done this, it was next their 
function to identify the nature of the block 
of responses as belonging to one of the 
categories that described the uniqueness 
of counselor statements. 

The coding procedure. One of the pre- 
liminary decisions that had to be made was 
the adoption of some means of identifying 
and classifying counselor responses. Studies 
by Porter (3) and Snyder (4) dealt with 
the analysis of the client and the counselor 
process, while in another study Bales (5) 
concerned himself with the analysis of the 
interaction process in most individual and 
group situations. The categories developed 
by Snyder were adopted in this study, since 
it was desirable to arrange the various 
categories on a continuum from the most 
directive procedures through semi-directive 
to nondirective procedures, and Snyder's 
system seemed most adaptable to such an 
arrangement. In addition, Snyder reported 
his system of categories as having a high 
degree of reliability in its use as a coding 
device. 

Responses were secured from the 22 ex- 
perts by presenting to them the entire 
series of 94 crude test items. Each of these 
response units was coded as belonging to 
one of the counselor categories as described 
in Snyder’s category system. The codings 
were then tabulated and the coding fre- 
quencies determined for the collected re- 
sponses for each test item. The cut-off point 
for the number of counselors responding in 
the same way was twelve. This represented 
slightly over one ‘half of the committee 
membership, and permitted the selection 
of 34 test items out of the total of 94 crude 
items. 


The reliability of the screening and cate- 
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gorization process was determined by com- 
paring the judgments of the committee of 

rts who coded the responses indepen- 
dently. The collected responses for each 
of the 34 criterion items were listed on 
separate sheets and distributed to the com- 
mittee of experts (now reduced to 20) who 
then proceeded to code the responses. The 
guiding factor in the coding process was 
that, in order for a criterion to be retained 
for inclusion in the final test form, the 
criterion coding should represent agree- 
ment in judgment on the part of at least 
half of the membership of the committee 
of experts. In cases where there was a 
wide range in codings, or where the con- 
sensus coding numbered less than half of 
the committee membership, the test item 
was to be removed from the criterion 
group. Examination of the codings made 
by the experts revealed a high degree of 
agreement, and it was possible to retain 
all 34 items of the criterion test. 

Validity and reliability. The validity of 
the test items was determined by the de- 
gree of agreement among the experts as 
to the nature of the collected criterion re- 
sponses. The question was raised as to 
whether the experts agreed that the criter- 
ion responses to a particular test item were 
similar, and if this was true, to what cate- 
gory vould they assign the collected re- 
sponses. 

To test the reliability of the instrument 
the total series of 34 criterion test items 
were administered to a sample population 
of 100 graduate students in the counseling 
and personnel training program of Boston 
University. A random numbers split-half 
was made of the test items, and the col- 
lected test data for each half was then 
scored separately. The score on the test 
consisted of a trichotomous frequency count 
of the subjects’ responses falling within 
each of three major category divisions— 
nondirective, semi-directive and directive. 
Reliability coefficients were then obtained 
between the halves of the test for each 
of the trichotomous scores, and then a 
mean reliability coefficient between the 
halves was obtained. The reliability co- 
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efficient for the entire series of test items 
was then obtained through use of the 
Spearman Brown Prophecy Formula. The 
results of these procedures are indicated 
in Tables 1 and 2. Examination of these 


Table 1 


Reliability Coefficients for the Trichotomous 
Scores of the Random-Numbers Split-Halves 
of the Entire Series of Test Items 











Trichotomous Size of 
Score Sample t SDr 
(a) (b) (c) (d) 
Nondirective 100 .945 +.01 
Semi-directive 100 -743 +.04 
Directive 100 .956 +.02 
Table 2 


The Mean Reliability Coefficient Between the 
Random-Numbers Split-Halves and the Spearman 
Brown Reliability Coefficient for the 
Entire Series of Test Items 








Description of 
Reliability Size of 
Coefficient Sample r SDr 
(a) (b) (c) (d) 
Mean r Between 
Halves 100 .88 +.02 
Spearman Brown r 100 .986 +.01 





tables shows that the test halves and the 
entire series of items possess a high degree 
of reliability. All of the obtained reliabili- 
ties appear to approximate each other so 
that one could say that the split halves of 
the test are reliable and can be utilized as 
reliable equivalent forms of the test. 


Results 


The result of the procedure outlined 
was the preparation of a free-response in- 
strument which can be used by counselor 
trainees to compare their counseling pert- 
ception with that of a group of experts in 
the field of guidance and counseling. The 
instrument in no way indicates whether 
the responses of the trainees are right or 
wrong, good or bad, but it does provide 
him with a valid and reliable means of 
comparing his responses with those of pro- 
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Accurate Clarification of 

Unverbalized Feeling XCFu 
Accurate Clarification of 

Feeling XCFa |_ 
Inaccurate Clarification of 

Feeling XCFi 
Restatement of Content XRC 
Simple Acceptance XSA 
Interpretation XIT 
Nondirective Lead XND 
Forcing the Topic XFT 
Structuring XCS 
Friendly Discussion XFD 
Proposing Client Activity XCA 
Approval and Encouragement XAE 
Giving Information xX]: ° 
Persuasion XPS 
Disapproval and Criticism XDC 
Reassurance XRS 
Direct Questions XDQ 





Nondirective Procedures 


Semi-Directive 
Procedures 


a 
a 
fe 
: 





Test Items 


128 45 6 7 8 9 10 11 12 18 14 15 16 17 


The profile for the Criterion Responses for Form A is indicated by: 
The Profile for the Criterion Responses for Form B is indicated by: 


Fig. 1. 


fessional workers in the field of guidance 
and counseling. 

More specifically, the results were as 
follows: 

1, Figure 1 gives a profile of the criter- 
ion responses to the 34 items on the test, 
17 in Form A and 17 in Form B. It may 
be noted that in Form A of the test all of 
the criterion items are coded as Accurate 
Clarification of Feeling, whereas in Form 
B all of the items except one are coded in 
the same way. This one exception is coded 
Restatement of Content. 

2. The experts’ responses as indicated 
in Table 8 showed a high degree of agree- 
ment. On two items the coding agreement 
was as high as 95 per cent, whereas on 


Counseling Perception Scale Profile Chart for Forms A and B. 


one item the coding agreement was as low 
as 65 per cent. It may be noted that only 
20 members of the criterion committee 
participated in this phase of the study. 

8. As may be noticed in Table 4, each 
criterion item was accepted by over half 
of the members of the criterion committee. 
For each item, the lowest number of coun- 
selors accepting the items was twelve, or 
54.5 per cent of the criterion committee, 
while the highest number was fifteen, or 
68.1 per cent of the committee. 

4, The percentage of counselor responses 
which were within the criterion group 
varied a good deal. Thus, as may be noted 
in Table 5, 12 counselors had 78 per cent 
or more of their responses appearing in the 
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criterion group. Six counselors had 17 per 61 per cent of their responses in the cri- 
cent or less of their responses falling within terion group. 

the criterion group; 2 had between 20 and 5. The 7 sae of criterion responses 
26 per cent; 2 others had between 55 and falling into the criterion group did not 


Table 8 


Distribution of Coding Judgment Frequencies, the Criterion Coding Category for 
Criterion Responses, and the Percentage of Agreement of 
Judgments of the Committee of Experts 








Frequency of Coding Judgments Made by Experts Total Criter- Per 

Test Number ion Cent 
Item un- of Coding of 

XRC XCFa XCFu XIT XCFi XRS classified Codings Agree- 

ment 

(a) (b) (c) (da) e) Oo @ (i) (i) (k) 
Al 2 18 20 XCFa 90 
A2 4 16 20 XCFa 80 
AS 1 17 2 20 XCFa 85 
A4 2 14 1 1 2 20 XCFa 70 
A5 8 17 20 XCFa 85 
A6 1 18 1 20 XCFa 90 
A7 4 16 20 XCFa 80 
A8 2 16 2 20 XCFa 80 
AQ 1 15 4 20 XCFa 75 
Al0 5 14 1 20 XCFa 70 
All 8 15 1 1 20 XCFa 75 
Al2 1 15 4 20 XCFa 15 

Al38 19 1 20 XCFa 

Al4 1 17 2 20 XCFa 85 
A15 18 2 20 XCFa 90 
Al6 2 17 1 , 20 XCFa 85 
Al7 8 15 1 z 20 XCFa 15 
Bl 8 17 20 XCFa 85 
B2 2 18 20 XCFa 90 
BS 5 15 20 XCFa 15 
B4 2 17 1 20 XCFa 85 
B5 2 16 1 1 20 XCFa 80 
B6 19 1 20 XCFa 95 
B7 8 14 8 20 XCFa 70 
B8 18 6 1 20 XRC 65 
B9 8 15 1 1 20 XCFa 75 
B10 2 15 2 1 20 XCFa 75 
Bll 8 17 20 XCFa 85 
B12 2 16 1 1 20 XCFa 80 
B13 1 17 1 1 20 XCFa 85 

Bl4 6 14 20 XCFa 70 © 
B15 1 17 1 1 20 XCFa 85 
B16 5 15 20 XCFa 15 
B17 18 1 1 20 XCFa 90 
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Table 4 
Distribution of Criterion Responses on Forms A and B 




















Test Number and Percentage Test Number and Percentage 
Item of Counselors Giving Item of Counselors Giving 
Criterion Responses Criterion Responses 
Number Percentage Number Percentage 
Al 12 54.5 Bl 18 59.0 
A2 15 68.1 B2 13 59.0 
As 13 59.0 B3 12 54.5 
A4 12 54.5 B4 15 68.1 
A5 12 54.5 B5 18 59.0 
A6 12 54.5 B6 18 59.0 
A7 13 59.0 B7 15 68.1 
A8 12 54.0 B8 12 54.5 
AQ 18 59.0 B9 12 54.5 
Al0 : 14 63.6 B10 12 54.5 
All 12 54.5 Bll 14 63.6 
Al2 13 59.0 B12 15 68.1 
Al 14 63.6 B13 12 54.5 
Al4 12 54.5 Bl4 14 63.6 
Al5 12 54.5 B15 13 59.0 
Al6 12 54.5 B16 13 59.0 
Al7 12 54.5 B17 12 54.5 
Table 5 Feeling, which might be described as a 


Counselor Responses in Criterion Group 


Counselor Number and Percentage 
of Responses in 
Criterion Group 











Number Percentage 
1 8 8 
2 33 97 
8 82 94 
4 7 20 
5 9 26 
6 19 55 
7 81 91 
8 28 82 
9 25 73 
10 83 97 
11 838 97 
12 33 97 
13 80 88 
14 26 76 
15 6 17 
16 2 5 
17 5 14 
18 8 8 
19 81 91 
20 25 73 
21 21 61 
22 8 8 





seem to be affected by the institution 
Where the expert received his doctorate 
training. With one exception, the criterion 
responses were Accurate Clarification of 


“nondirective” response. The 4 experts who 
had the highest number of responses (97 
per cent), falling within the criterion 
group, received their doctorate training 
at the University of Chicago, Columbia, 
Harvard, and the University of Minnesota. 
On the other hand, those experts who had 
the smallest proportion of their responses 
falling within the criterion group (less than 
8 per cent), received their doctorate train- 
ing at Harvard, the University of Michigan, 
the University of Buffalo, and George 
Washington University. Four members of 
the criterion committee were University of 
Chicago graduates. The percentage of their 
responses within the criterion group were 
14 per cent, 17 per cent, 73 per cent, and 
97 per cent. Four members of the commit- 
tee were Columbia graduates. The per- 
centage of their responses within the cri- 
terion group were 26 per cent, 73 per cent, 
91 per cent, and 97 per cent. 


Conclusions 


1. There was a high degree of agree- 
ment among the experts regarding their 
response behavior in the structured situa- 
tions represented by the test items. 
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2. There was as much disagreement 
among experts who obtained their doctoral 
training in the same institution as there was 
among those experts who received doctoral 
training in different institutions. Thus the 
four experts who had the highest number 
of nondirective responses received their 
doctoral training at, respectively, the Uni- 
versity of Chicago, Columbia, the Univer- 
sity of Minnesota, and Harvard. 

8. To varying degrees, the responses of 
every member of the committee of experts 
appeared in the criterion response cate- 
gories. 

4. The similarity of the responses of the 
jury of experts to the widely diversified 
client comments is of some significance. 
Counselor trainees should find it interesting 
to compare their responses with those of 
the jury of expert counselors. 

5. The test items as selected by the “wd 
cedure followed in the study are vali 
that they did result in a criterion response 
from at least 54.5 per cent of the members 
of the criterion committee. 

6. The reliability of each half of the 
series of items appeared to be high. 


Dugald S. Arbuckle and Edward A. Wicas 


7. It may thus be concluded that the 
instrument can be used as a valid and re 
liable device which provides a means for 
comparing the response behavior of coun- 
selor trainees with the response behavior of 
expert counselors. 


Received February 20, 1957. 
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Comment 


Arbuckle and Wicas have developed a 
free response instrument of considerable 
potential value. Certainly both experts and 
novices should find it stimulating to com- 
pare their counseling perceptions (I would 
prefer the term counseling approach or 
counseling sensitivity) with other experts. 

However, the reader should remember 
that the quantitative treatment reported in 
the article is directed only to the coding 
or categorization of the responses, not to 
the responses themselves. Thus, the im- 
pressive quantitative analysis of the instru- 
ment has meaning only to the extent that 
Snyder's categorization system is relevent 
to the user’s purposes. 

A coding system is essentially a means 
of abstracting along selected dimensions 
the commonality in counselor responses. 


This is at once both an advantage and a 
disadvantage. Its advantage is that a large 
number of unique counselor responses can 
become more understandable and more 
manageable; its disadvantage is that the 
abstracting process may conceal important 
differences. 

For example, it may be useful to learn 
what proportion of the experts responded 
to a given counseling situation by clarifying 
the client’s immediate feeling. On the other 
hand, the client may have expressed several 
feelings in the same item, and different 

experts may have selected one or another 

of these feelings to emphasize in theit 
responses, Or a categorization system dif- 
ferent from Snyder’s might re-group the 
responses by finding commonality along 
other dimensions, 
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This line of thought suggests that the 
raw data collected by Arbuckle and Wicas 
may prove more useful for certain purposes 
than the refined instrument and coding 
system to which the quantitative treatment 
is directed. 

A remarkable characteristic of this in- 
strument is that the modal response type, 
as determined by the judges, is for 33 of 
the 34 items “accurate clarification of feel- 
ing.” Even the one remaining item shows 
a closely related response type. On the 
face of it, Carl Rogers appears to be the 
most successful salesman of our time! But 
on other grounds it seems unlikely that this 
diverse and apparently randomly selected 
group of experts would adhere so unani- 
mously to the client-centered approach. 
This, and an attempt to save Rogers from 
being cast into a mold his self-concept 
would reject, leads one to search for some- 
thing in the method which might artificially 
produce this apparent preference for non- 
directive responses. 

Perhaps part of the explanation lies in 
the fact that about two-thirds of the orig- 
inal items were dropped from the instru- 
ment because they produced a variety of 
response woe If the criterion group was 
in fact made up of counselors holding to 
differing theoretical persuasions, it may be 
that the discarded items tended to bring 
out difference among counselors, whereas 
the retained items were of a type which 
impelled most experts, even though advo- 
cating different approaches to counseling, 
to aim at clarification of the immediate 
feeling. 

Other explanations are also possible. For 
example, the items present only small seg- 
ments of an interview, a fact which may 
discourage such response types as “inter- 
pretation” or “proposing client activity.” 
Neither can the items simulate the inter- 
personal relationship between counselor 
and client which is always an important 
factor in the interview. For some counselors 
this might tend to discourage “friendly 
discussion,” “persuasion,” “reassurance,” 
and “disapproval.” Another possibility is 
that a cross-validation of the retained 
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items would produce more counselor vari- 


ability. 
Whatever the proper explanation, it 
seems highly doubtful that we can conclude 


from the data that “accurate clarification 
of feeling” is the preferred response type 
of expert counselors over the nation. Users 
of the instrument should recall that at least 
some of the experts employed other re- 
sponse types with items not contained in 
the final instrument. 

In fact, the plan of discarding items 
which failed to elicit agreement among the 
experts, while sound for certain purposes 
which the authors had in mind, is open to 
objection. In the past we have tended im- 
plicitly to assume that there is a “best 
response” if we could only discover it. But 
clinical observation and some recent re- 
search suggest that the counselor's person- 
ality, the client, and the response must be 
considered as a unit. In other words, what 
is the best approach for one counselor with 
a given client and counseling situation 
might be the wrong approach for another 
counselor. Thus the discarded items to- 
gether with their varying counselor re- 
sponses could be of value to trainees. Their 
sensitivity to their clients might be in- 
creased by being exposed to the variety 
of meanings seen by experts in the counsel- 
ing material, 

That there are two forms of the instru- 
ment should greatly increase its value 
where pre- and post-measures are desired, 
as, for example, for research or for evaluat- 
ing training procedures. For such purposes 
the high reliability coefficients are most 
encouraging, but they also have limitations 
which should be noted. 

First, the reliability coefficients refer 
only to the broad grouping of responses 
into directive, semi-directive, and non- 
directive responses. We cannot determine 
from the data whether the two forms are 
equivalent when finer discriminations are 
wanted, as, for example, when the user 
might wish to distinguish between accurate 
and inaccurate clarification of feeling. 

It should be further noted that the mean 
reliability of the three response types has 
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little meaning since the instrument does 
not yield a total score. Instead it yields 
three scores. The authors should have com- 
puted three Spearman-Brown 1's to estimate 
the full scale reliability. 

In spite of these cautions, the instrument 
has the merit that it offers two forms which 
can be used reliably to determine a sub- 
ject’s tendency to respond directively or 
nondirectively and, to a lesser extent, semi- 
directively. However, this statement holds 
only to the extent that future users of the 
instrument become as proficient in applying 
Snyder’s coding system as were the investi- 
gators. Since the reliability coefficients 
reflect both stability of response tendency 
and the ability of judges to code accurately 
the response, any decrease in coding ac- 
curacy will decrease the reliability of ob- 
tained scores. 

Thus, this instrument, on the basis of 
the data presented, may have a limited 
usefulness for the purpose of yielding ob- 
jective scores for those users who do not 
wish to invest the effort required to apply 
Snyder’s coding system. 

Another instrument yielding scores to 
reflect response tendency was reported by 
Porter in his book, An Introduction to 
Therapeutic Counseling. Porter’s instrument 
used multiple choice procedures whereby 
each of five possible choices taps a differ- 
ent response tendency. Arbuckle and 
Wicas’ instrument has the advantage of 
requiring free responses, but it has the 
disadvantage of being more cumbersome 
to score. 
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A further comment is directed not to the 
instrument itself but to its use in a coun 
selor training program. 

A printed segment of a counseling inter. 
view, or even a recording or a movie, can 
never reproduce the affective relationship 
that develops between counselor and client, 
As I see it, to the extent that our training 
procedures neglect the experiential aspects 
of the counseling relationship, we tend to 
produce technique-oriented counselors- 
ie., counselors who focus more upon the 
form and content of their responses than 
upon the client with whom they are in 
relationship. It is quite possible, for ex 
ample, to make technically good responses 
in a manner which leads the client to ex. 
perience the counselor as aloof and un 
caring. In part, this is what Rogers has in 
mind when he emphasizes the attitudinal 
orientation of the counselor. 

I make this point because I do not be 
lieve we greatly improve our effectiveness 
by learning what would have been a tech 
nically better response to make at any 
given point in the interview. A more sig- 
nificant kind of learning occurs when we 
can say, “Now I experience more of the 
meaning and significance of what my client 
was trying to say.” 

This gratuitous comment is not a criti- 
cism of Arbukle and Wicas’ work, for theit 
instrument as a training device could er 
courage either kind of learning. All would 
depend upon how it is used. 


Donald L. Grummon 
Michigan State University 
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The Effects of Different Methods of Test 


Introduction and Interpretation on Client 


Learning in Counseling 


John W. Gustad * 
University of Maryland 
Abdul H. Tuma 
American Psychiatric Association, Washington, D. C. 


Until quite recently, much research con- 
cerned with interviewing has dealt with 
what might be calléd peripheral or struc- 
tural variables. That is, many studies were 
conducted which described the character- 
istics of clients, attempted to make predic- 
tions about their likelihood of achieving 
success through treatment, or evaluated 
the outcomes of counseling. Dealing with 
the interview process itself, on the other 
hand, and any number of the significant 
variables involved presents tremendous 
problems. 

The use of tests in the counseling inter- 
view has been a topic for discussion (Gus- 
tad, 8), but research on their utilization is 
a recent development. Bordin and Bixler 
(8) wrote an article in which they suggest- 
ed that maximizing client participation in 
test selection would have desirable effects. 
Seaman (12) conducted a study in which 
he allowed clients to have free rein in test 
selection, and he found that they tended 
in general to make appropriate choices. 

Bixler and Bixler (2) discussed test inter- 
pretation methods and also favored maxi- 
mum client participation. Several studies 
have in general supported this hypothesis 
(Carnes & Robinson, 4, Danskin & Robin- 
son, 5, Forgy & Black, 7, and Kamm & 
Wrenn, 10). Of particular interest is the 
work of Dressel and Matteson (6). They 

1The study being reported was supported by a 
tesearch contract, Nonr 1225-(00), from the Per- 
sonnel and Training Branch, Office of Naval Re- 
search. The opinions expressed are the authors’ 


and do not necessarily reflect those of the Navy 
Department. 


tested three hypotheses: first, that clients 
who participate most actively in test inter- 
pretation gain most in self-understanding; 
second, that these clients also become more 
certain of their final vocational choice; 
third, that more actively participating cli- 
ents are more satisfied with the counseling 
process. Their data tended to confirm the 
first two hypotheses, but the third hypothe- 
sis was neither confirmed nor denied. 

Of concern in such studies is the matter 
of obtaining measures of outcomes, partic- 
ularly with respect to what clients learn 
about themselves. Berdie (1), Rogers (11), 
and Singer and Stefflre (13) have reported 
studies relevant to this problem. Berdie 
used a counseled group and a noncounseled 
experimental group, administering pre- 
and postcounseling measures to each. 
These were self-rating forms. He obtained 
correlations between ratings and test scores 
both pre- and postcounseling. He conclud- 
ed that such a procedure was a potentially 
useful one for evaluating counseling. Rog- 
ers used two different methods of counsel- 
ing, one emphasizing client participation, 
the other not overtly seeking it. He also 
used pre- and postcounseling ratings as his 
dependent variable. He found no differ- 
ences between the methods, but the rating 
system appeared useful. 

Singer and Stefflre (13, pp. 252-253) 
challenged the methodology of such studies 
as follows: 

Obtaining a correlation between precounsel- 

ing self-estimates and test scores and post- 

counseling self-estimates and test scores does 
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not reveal the relevant information to permit 
an evaluation of counseling. Such a correla- 
tion provides no recognition of the discrepan- 
cies between the first rating and actual score 
as compared with the. discrepancies between 
the second rating and the actual score. What 
we really want to find out in using the self- 
estimate technique is whether the individual’s 
self-estimate deviates less from his actual 
score than it did before. 


Using high school students, these authors 
conducted a study using the above tech- 
nique. They found no significant improve- 
ment among their men but did find signifi- 
cant improvement among their women on 
a test of occupational interests. 


Hypotheses 


Six hypotheses were set up for testing 
in this study. They were tested in the null 
form, but they are presented here posi- 
tively: 

1. Different methods of interpretation of the 
results of a scholastic aptitude test (ACE) lead to 
differential amounts of learning about self. 

2. Different methods of interpreting the re- 
sults of a reading comprehension test (Coop. C-2) 
lead to differential amounts of learning about 
self. 

8. Different methods of introducing and in- 
terpreting results of a vocational interest test 
(Strong VIB) lead to differential amounts of 
learning about self. 

4, There is a positive correlation between pre- 
counseling accuracy of self-estimates regarding 
academic aptitude, reading comprehension, and 
vocational interests and learning about self with 
respect to these variables. 

5. There is a positive relationship between 
academic aptitude, measured by the ACE, and 
accuracy of precounseling self-estimates. 

6. There is a positive correlation between pre- 
counseling accuracy of self-estimates and the 
amount of learning about self in counseling. 


Method 


The present study was conducted in 
conjunction with another which dealt with 
the effects of client and counselor per- 
sonality characteristics on client learning in 
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counseling (Tuma & Gustad, 14). The de. 
tails of the design and methodology are de. 
scribed there, and these will be only brief. 
ly summarized here; for details, the reader 
is referred to the other study. 

The subjects were fifty-eight male un. 
dergraduates on the College Park campus 
of the University of Maryland. All had ap- 
plied to the Counseling Center for assist- 
ance in occupational choice. Before coun- 
seling, all completed a Self-Knowledge In- 
ventory. This instrument, a self-rating de- 
vice containing graphic scales related to 
a number of ability, aptitude, and interest 
variables, was based on a similar instru- 
ment originally devised by Dressel and 
Matteson (6). This instrument was admin- 
istered again after counseling. 

Three measures were used to describe 
the dependent variable, client learning, 
These were: (a) d,, initial discrepancy be 
tween rated and tested positions; (b) d, 
postcounseling discrepancy between these; 
(c) D, the difference between d, and d, 
Appropriate adjustments were made by co- 
variance methods to allow for the effects 
of initially large or small discrepancies. 

Clients were assigned at random to one 
of the twelve cells of a three by four fac- 
torial design. The rows were made up of 
four methods of test interpretation, the 
columns of three methods of test introduc- 
tion. The details of the experimental con- 
ditions contained in each of the cells are 
described in the article referred to above, 

Results 

1. The first hypothesis dealt with the 
effects of different methods of test inter- 
pretation on client learning with respect 
to scholastic aptitude (ACE). An analysis 
of covariance was performed so that the 
effects of initial discrepancy would be con- 
trolled. The results are shown in Table L 
In this analysis, self-estimates for the Quan- 


Table 1 
Analysis of Covariance for Amount of Learning with 
Regard to ACE for Treatments A, B, C, and D 








Source df 3x" Sx Sy? Sy? df MS F 
Between 8 55.5293 23.8233 12.1801 2.8775 8 .7925 1 
Within 55 880.5046 128.8128 282.4128 232.2084 54 4.8002 

Total 58 886.0889 152.1856 294.5424 234.5859 57 
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Table 2 
Complete Analysis Variance and Covariance for 
Amount of Learning with Regard to Reading 
Skills for Treatments A, B, C, and D 
Source df Sx Sry Sy* Sy’? df MS F 
Between 3 2.9700 8.7125 6.0829 2.3286 8 .7762 z 
Within 45 171.5198 119.8998 197.1824 118.8672 44 2.5765 
Total 48 174.4898 123.6122 203.2653 115.6958 47 : 
titative, Linguistic, and Total scores of the with the within-variance term. The analysis 


ACE were pooled. Hartley's test (9) for 
homogeneity of variances was negative in- 
dicating homogeneous variances. On the 
basis of the analysis contained in Table 1, 
the null hypothesis, that there were no dif- 
ferential effects of various test interpreta- 
tion methods, was accepted. 

2. A similar analysis was performed with 
respect to the Cooperative Reading Com- 
prehension Test, C-2. Again, a covariance 
adjustment was made for size of initial dis- 
crepancy. The test for homogeneity was 
negative and indicated homogeneous vari- 
ances. The results of the analysis of covari- 
ance are contained in Table 2. Once again, 
the null hypothesis regarding a lack of dif- 
ferential effects of different methods of 
test interpretation was accepted. 

8, The analysis of the data relative to the 
Strong VIB was more complex. The com- 
plete factorial design was employed since 
both test introduction and test interpreta- 
tion methods were involved. The interac- 
tion term, interpretation versus introduction 
methods, was first tested, and it was found 
to be insignificant. It was therefore pooled 


Table 3 


Analysis of Variance for Clients’ Learning in 
Counseling about Vocational 
Interest (Unadjusted) 


Source df Sy? MS F 


Methods of Test 93 121.2272 40.4091 2.3697 

Interpretation 

(Row) 

Methods of Test 

Selection 

(Column) 

Within and 

Interaction 
Total 47 








2 48.3742 24.1871 1.4184 


42 716.1969 17.0523 1 





of variance, including this pooled term, is 
shown in Table 3. Neither the row nor the 
column effects were significant. The null 
hypothesis was therefore accepted. Two 
other tests were made in connection with 
this. Hartley’s test indicated homogeneous 
variances. Also, a covariance analysis was 
performed to assess the effects of different 
initial discrepancies. This analysis was neg- 
ative, indicating that such initial discrep- 
ancies had no effects on the above results. 

4. The three major hypotheses having 
been refuted, three subsidiary hypotheses 
are of interest. The first of these states 
that initial accuracy of self-estimate is posi- 
tively related to final criterion performance. 
Having, in the analyses above, demonstrat- 
ed the absence of significant treatment 
effects, it seemed worthwhile to assess in- 
dependently the correlation based on all 
elements in such regression. Table 4 pre- 
sents the results of this analysis. All of the 
obtained z values are significant at or be- 
yond the .01 level. Based on the totality of 
regression, then, it may be concluded that 
there was a significant relationship be- 
tween precounseling self-knowledge and 
subsequent gains in self-knowledge. This 
may at first appear to be contradictory to 
the results presented earlier, but it may be 
explained in terms of the reduction of the 
regression coefficient as a result of the sub- 
traction of that portion of the variance not 
common among the various groups. 

5. The next hypothesis is concerned with 
the existence of any relationship between 
the accuracy of precounseling estimates 
and scholastic aptitude. The question, in 
other words, is whether brighter students 
are in general more insightful. Product 
moment correlations were calculated and 
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Table 4 
Test of Relationship Between Errors of Initial 
Self Estimates (d,) and Increase in Accuracy of 
Self Judgment (D) in Areas of Academic Ability, 
Reading Skills, and Vocational Interest 
s 
Variable N Zz SDz 2s) 
Academic Ability, d, x D 59 A512 486208 .13361 8.6384 
Reading Skills, d, x D 49 6564 -785767 .147442 5.3298 
Vocational Interest, d, x D 58 4541 489709 134840 8.6318 
Table 5 
Data for the Test of the Three Subsidiary 
Sections of Hypothesis 5 ~ 
Le 
Variable N Zz SDz 2s) 
ACE —d,a 59 —.2374 —.241595 183631 1.8079 
ACE —d,r 48 .1187 .114498 .149071 -7681 
ACE — d,i 55 0346 .085014 .188675 0252 





transformed by means of Fisher’s z. The 
results are shown in Table 5. All three fall 
short of the level required for significance 
and it was concluded that initial accuracy 
of self-estimate was not related to bright- 
ness as measured by the ACE. 

6. The final hypothesis concerns any re- 
lationship which might exist between scho- 
lastic aptitude and final, criterion perform- 
ance. That is, there seemed good reason to 
expect that brighter students would learn 
more. Three separate criterion measures 
were used: D,, which dealt with scholas- 
tic aptitude; D,, which dealt with in- 
comprehension; D,;, which dealt with in- 
terests. Product moment correlations with 
ACE scores were obtained and transformed 
by means of Fisher’s z. These results are 
included in Table 6. None of the three cor- 
relations attained the level required for 
significance, and it was concluded that, at 


least within the conditions of the present 
study, different methods of handling test 
introduction and test interpretation do not 
have any significant differential effects on 
client learning. This conclusion goes con- 
trary to most of the presuppositions current 
in the counseling field. Although generali- 
zation beyond the specific confines of the 
study is dangerous, these results also sug- 
gest the need for critical examination of the 
effects of other techniques variables in 
counseling. 

What is required, of course, is a more ex- 
tensive and comprehensive test of these and 
related variables and hypotheses. As noted 
above, the present study included only 
male subjects. They were also college stu- 
dents, and they were all concerned with 
vocational choice problems. Moreover, the 
counselors involved represented quite simi- 
lar systematic orientations and levels of 


Table 6 


Data for the Test of the Three Subsidiary 
Components of Hypothesis 6 





— 





Variable N Zz SDz’ 2s) 

ACE — D, 59 771 .178928 .188631 1.3390 
ACE—D, 48 -1608 .162208 .149071 1.0881 
ACE —D, 55 .0804 .080574 .188675 5810 
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Effects of Methods of Test Introduction and Interpretation 


experience. All of these variables should be 
manipulated in order to determine the lim- 
its of the applicability of these results. 

The present study does, however, call 
into serious question some of the widely ac- 
cepted ideas and opinions about counseling 
methods as these relate to specific tech- 
niques. It also suggests results of several 
studies cited might provide provocative 
leads toward an improved understanding 
of the counseling process and more ac- 
curate assessments of the specific questions 
concerning this process. 


Summary 


In an attempt to study the differential 
effects of different methods of test intro- 
duction and test interpretation, three meth- 
ods of introduction and four of interpreta- 
tion were selected. Clients seeking assist- 
ance with vocational choice were assigned 
to one of the twelve cells and one of three 
counselors at random. Counseling then fol- 
lowed the lines prescribed by the cell 
characteristics. 

Pre- and postcounseling self-ratings were 
obtained relative to abilities and interests. 
These were compared with tested positions 
on these variables. The discrepancies noted 
were taken as measures of client status and 


g. 

On the basis of the results obtained, the 
following conclusions were drawn: 

1. Different methods of test introduction 
showed no significant, differential effects 
on client learning. 

2. Different methods of test interpreta- 
tion showed no significant differential ef- 
fects on client learning. 

8. The interaction between introduction 
and interpretation methods was not signifi- 
cant. 

4, Initial accuracy of self-ratings was pos- 
itively related to learning by the client. 
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5. Initial accuracy of self-ratings was not 
related to scholastic aptitude. 

6. There was no relationship between 
scholastic aptitude and client learning 
about self during counseling. 


Received August 23, 1956. 
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Research Notes from Here and There 


Time-Limited Psychotherapy: 
An Experimental Investigation of Practical Values and 
Theoretical Implications 


John M. Shlien* 
University of Chicago 


Within the program of research under- 
way at the Counseling Center, one project 
is designed to test the effect of time limits 
on process and outcomes of therapy.? The 
project stems from a practical problem 
faced by many clinical agencies—a demand 
for service exceeding the supply—and from 
a history, almost as long as the history of 
psychotherapy, of controversial speculation 
on the consequences of termination. The 
problem of when and how to terminate 
is met in a variety of ways by different 
therapeutic orientations. Traditionally, the 


1For generous support in its early phase, we are 
indebted to the Wieboldt Foundation. Further 
analysis of the data is made possible by the grant 
of the Ford Foundation (Psychotherapy Research 
Program) to the Counseling Center, University of 
Chicago. 


2In a project of this size, the resources of the 
entire Center are necessarily utilized. A large 
number of staff members have invested their time 
and energies in especially valuable ways; develop- 
ing instruments, in the design and administration 
of the project, transcription of recordings, col- 
lection and analysis of data, and of course in 
serving as counselors in the time-limited experi- 
mental group. Many of them will be publishing 
separate studies based on these data, and some, 
R. H. Jenney, E. Gendlin, W. E. Henry, and 
Marjorie L. Page, have already reported such 
work at recent meetings of the American Psycho- 
logical Association. As a small note of thanks for 
large services, the following are gratefully 
acknowledged: John M. Butler, Desmond Cart- 
wright, Lowell Colston, Bruce Cushna, Charlotte 
Ellinwood, Richard Farson, Eugene Gendlin, Moy 
Fook Gum, Vera John, Richard Jenney, G. Bar- 
rett-Leonard, Madge K. Lewis, Elaine McMaster, 
Donald Nachand, Marjorie L. Page, Carl Rogers, 
Hellene Sarett, Stanley Standal, Vivian Wagner, 
Alice Wagstaff. 


client-centered therapist has permitted the 
client to set the point of termination as 
well as to direct the course of therapy. In 
this experiment, the termination for two 
segments of the population was set in ad- 
vance, arbitrarily, so that the course of 
therapy was time-limited. This radical de- 
parture from the customary procedure may 
result in findings which will have impor- 
tant practical and theoretical implications. 


The Practical Problem 


In the past few years, the trend at the 
Counseling Center has been toward longer 
cases. Seeman points this out in his recent 
review (8) 

“The average length of therapy in 1954 
was thirty-one interviews as compared with 
six interviews in 1949. In the 1954 study 
the clients were in therapy for an average 
of 33 weeks. One may question whether 
client-centered therapy can any longer be 
thought of as ‘brief’ therapy.” 

Since this observation, case length has 
continued to grow. Whether this is a wide- 
spread or local phenomenon and whatever 
else it may mean, it brings about a long 
waiting list. One way of meeting this prob- 
lem is to make the most effective use of 
the counseling staff in relation to a larger 
number of clients. To insure a program of 
brief therapy, some form of limits in time 
must be imposed, whether in spacing, or 
in terminating, the course of therapy. That 
is the practical problem. 


The Theoretical Problem 


The problem of termination has always 
been a crucial and perplexing one. When 
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is the end? What is the end? Is there an 
end? Freud considered these three ques- 
tions, and described his experience (with 
the patient now known as the “wolf man” 
in psychoanalytic literature) thus: 

“I have employed the method of fixing a 
date for termination of analysis in other 
cases and I have also inquired about the 
experience of other analysts in this respect. 
There can only be one verdict about the 
yalue of this blackmailing device. The 
measure is effective, provided one hits the 
right time at which to employ it. But it 
cannot be held to guarantee perfect ac- 
complishment of the task of psychoanalysis. 
On the contrary, we may be quite sure 
that, while the force of the threat will have 
the effect of bringing part of the material 
to light, another part will be held back 
and buried, as it were, and will be lost to 
our therapeutic efforts” (1). 

Clearly, Freud had no confidence in the 
value of an advance termination, beyond 
that of a coercive pressure to be used as 
a “last resort” when the therapist felt dis- 
satisfied. 

One of the “dissidents,” Otto Rank, de- 
liberately used the device of “end-setting,” 
and as readers of the above mentioned 
essay know, drew Freud’s wrath for it. Ac- 
cording to some students (Karpf, 3) of 
Rank, end-setting was used to “project the 
end-phase forward” and elsewhere is inter- 
preted as having connections with his theory 
of birth trauma and separation anxiety 
(Munroe, 4). Rank himself speaks of time 
limits mainly as means to mobilize the con- 
structive force of the “will conflict.” Time 
limits themselves seem to have had no spec- 
ial meaning for him; “forbidding to the pa- 
tient certain foods, smoking, or sexual activ- 
ity might have presented the same chal- 
lenge to the will.” Time limits were simply 
logical and opportune, being so general 
and unavoidable (Rank, 5). 

Jessie Taft, Rank’s translator and an im- 
portant theorist in her own right, amplified 
the significance of time limits. She called 
them “one of the most valuable tools ever 
introduced into therapy,” and argued that 
time is the supremely representative sym- 
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bol of all limitations in living. “To put it 
very simply,” she says, “perhaps the hu- 
man problem is this: If one cannot live 
forever, is it worth while to live at all?” 
Her emphasis on quality instead of quan- 
tity leads to her now famous statement on 
the “single contact”: 

“If there is no therapeutic understanding 
and use of one interview, many interviews 
equally barren cannot help. In the single 
interview, if that is all I allow myself to 
count upon, if I am willing to take that 
one hour in and for itself, there is not time 
to hide behind material, no time to ex- 
plore the past or future. I myself am the 
remedy at this moment if there is any and 
I can no longer escape my responsibility, 
not for the client, but for myself and my 
role in the situation. Here is just one hour 
to be lived through as it goes, one hour 
of present immediate relationship, however 
limited, with another human being who has 
brought himself to the point of asking for 
help” (9). 

To come to terms with the limits in time 
also defines the very goal and process of 
therapy: 

“, .. as a process in which the individual 
finally learns to utilize the allotted hour 
from beginning to end without undue wear, 
resistance, resentment or greediness. When 
he can take it and also leave it without 
denying its value, without trying to escape 
it completely or keep it forever because of 
this very value, in so far he has learned to 
live, to accept this fragment of time in and 
for itself, and strange as it may seem, if he 
can live this hour he has in his grasp the 
secret of all hours, he has conquered life 
and time for the moment and in principle” 
(9). 

Rogers has taken the position that “the 
time limits of the therapeutic situation, like 
any of the other limits, are of assistance in 
furnishing the counseling situation with all 
the aspects of the life situation. The time 
limit sets up an arbitrary human limit, to 
which the client must make adjustment. 
While it may be a microscopic issue com- 
pared to the issues in real life, yet it al- 
lows for all the feelings and patterns with 
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which he responds to the larger issues” 
(6). Rogers, however, recommends time 
limits only in connection with the hour of 
the appointment, not the duration of ther- 
apy. That he would leave to the client. 
He adds an important point when he says 
of time limits: “Brief mention might also 
be made of the help they give to the thera- 
pist. In the first place, they allow the 
counselor to be more comfortable and to 
function more effectively. They provide a 
framework in which the counselor can be 
free and natural in dealing with the client.” 

Jung has brought time limits into play 
in connection with the spacing and num- 
ber of interviews, rather than the duration. 
He says: 

“The psychoanalyst thinks he must see 
his patient for an hour a day for months 
on end; I manage in difficult cases with 
three to four sittings a week. As a rule I 
content myself with two, and once the 
patient has got going, he is reduced to one. 
In the interim, he has to work at himself, 
but under my control. I provide him with 
the necessary psychological knowledge to 
free himself from my medical authority as 
speedily as possible. In addition, I break 
off treatment every ten weeks or so, in or- 
der to throw him back on his normal milieu. 
In such a procedure time can take effect 
as a healing factor, without the patient's 
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having to pay for the doctor's time. With 
proper direction, most people become cap. 
able of making their contribution—however 
modest at first—to the common work. In 
my experience the absolute period of cure 
is not shortened by too many sittings” (2), 


The Design 


Out of this diverse theoretical back. 
ground an experiment has developed. As 
shown in Figure 1, one group of clients 
(Segment I) is offered a maximum of 2% 
interviews. A second group (Segment III) 
is offered 20 interviews with a ten-week 
“waiting period,” then the option of 2 
more interviews if they wish. A third gr 
is offered therapy without time limits, i 
divided into longer and shorter subgroups 
after voluntary termination. The suggested 
rate is two interviews per week. Two con- 
trol groups from previous research (7)—an 
“own-control” and an “equivalent-control’ 
are added to the comparison. 

The design is a rough approximation of 
what can be executed in fact. Clients do 
not mechanically conform to a plan of re- 
search, nor, for their sakes, would we want 
them to do so. Obvious flaws and crudities 
ia the plan mar its value. Ideally, “matched 
triplets” would be randomly assigned to 
the three treatments (brief limited, longer 





















































limited, and unlimited). Since one has not 
PRE-THERAPY 10 TH. WEEK 20 TH. WEEK 30 TH. WEEK 
TESTING TESTING TESTING TESTING 
/ ! 1 : 
i] 
SEGMENT | ' ‘ 
BRIEF, LIMITED a teen : 
‘ t ] 
t 
’ ; H : 
SEGMENT II [THERAPY | 
LONGER, UNLIMITED r r 
t 
: ; ‘ ' 
f ‘ t 
SEGMENT III THERAPY ----WAIT----] THERAPY 
LONGER, LIMITED 
1 
’ ' ; ' 
’ ' ‘ - 
SEGMENT IV ' : 
BRIEF, UNLIMITED gts age H : 
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an army of clients and counselors await- 
ing assignments, it is not possible to pre-test 
and equate clients for beginning status on 
even a single criterion. The permutations 
with multiple criteria of low intercorrela- 
tions would be insurmountable. Besides be- 
ginning status, individual rate of change 
would be essential information for a per- 
fect experiment, and this is beyond present 
knowledge. Counselors cannot be matched, 
or held constant, in an experiment of this 
size, Many questionable assumptions about 
individual meanings of time and limits are 
involved, Yet the design has, at this time, 
been largely carried out, and with provoca- 
tive results according to early analysis of 
the data. 

The design lends itself to a number of 
comparisons. Chief among them is that 
fourfold one between longer and shorter 
cases, both limited and voluntarily ter- 
minated. The reader may also see how, ac- 
cording to Figure 1, the schedule of test- 
ing for all clients at ten-week intervals 
affords comparison of cases ending, on the 
average, after 20, 40, and 60 interviews, 
and one may also study the change during 
equal intervals of time, with or without 
therapy. Since there is for the unlimited 
cases an “own control” period equal to the 
‘between therapy wait” in Segment III, 
time without therapy may be studied pre- 
ceding, between, and following therapy 
periods. 

Several criteria are being used in the 
study. The Butler-Haigh Q-sort, Thematic 
Apperception test, and counselor outcome 
ratings are three common to both time- 
limited and unlimited cases, as are impor- 
tant behaviorial criteria such as “attrition” 
tate and return-to-therapy rate. In con- 
nection with the time-limited cases, we are 
particularly interested in observations re- 
lated to the time sense and orientation of 
the client. For them, data have been col- 
lected in a survey of attitudes covering 
time and limits, a time estimation test, 
physiological measures such as basal temp- 
erature and pulse rate, and the working 
time on all psychometric measures such as 
Q-sort and TAT. And there are, of course, 
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interview recordings of complete cases, to 
be used in judging process, with some 
counselor and client rating scales of process 
elements. 

At this time, only the briefer (20 inter- 
views) time-limited cases have been an- 
alyzed. From comparisons on most of the 
instruments and measures, we know that 
it compares very favorably with, and often 
exceeds, results of longer unlimited ther- 
apy. A warning note comes from the TAT. 
In a blind analysis under the direction of 
W. E. Henry, the brief time-limited cases 
show sharp decline in a theoretically de- 
sirable score (affective complexity) dur- 
ing the follow-up period six months after 
therapy ends. These and other details of 
analysis will be reported when analysis is 
more complete. Meanwhile, a collaborative 
study is being conducted by the Alfred 
Adler Institute of Chicago. There a group 
of Adlerian psychiatrists and psychologists 
headed by Rudolph Driekurs are replicat- 
ing the brief time-limited situation. This 
will provide, among other things, valuable 
data on common and specific effects of two 
types of therapy. Data from these projects 
will be available to qualified researchers, 
and their requests, as well as comments 
and suggestions, will be welcome. 

At the Counseling Center, the next step 
in research on time limits in therapy will 
be to undertake a project in which the 
limit is not arbitrary, but is adjusted to 
the needs and situation of the client as 
well as the counselor, and in which the 
client participates in the decision to set the 
termination in advance. This, it is believed, 
will retain all the demonstrated values of 
time limits, and eliminate any detriments 
which stem from the arbitrariness of the 
uniform limits in the present experiment. 
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Reliability of Mental Ability Tests 


Many counselors find that the results of 
tests administered to incoming freshmen 
at the beginning of school are inaccurate 
in predicting success in college. 

The present study tested the hypothesis 
that tests administered later in the semes- 
ter are more useful to the counselor in 
predicting scholastic achievement as well 
as in vocational guidance. 


Procedure 


The Otis Mental Ability Test (Form 
AM) was administered during the first 
class period to 350 North Texas State Col- 
lege freshmen who were enrolled in a 
course primarily devoted to orientation. 
Two months later Form BM of the Otis 
was administered to each student. 

The raw scores were treated statistically 
as follows: 

1. Correlations were computed between 
the grade point average for the first semes- 
ter in college and the scores on each of 
the tests. 

2. The significance of the difference be- 
tween the two correlations of grade point 
averages and test scores was determined. 
An appropriate formula for correlations 
based on the same sample of N cases was 
used (1). 

8. The critical ratio was computed to 
determine whether the difference between 
the means of the two mental tests was 


significant. 


4. The correlation between the raw 


scores of the two tests was calculated, 


Results 


The correlation between the grade point 
averages and the initial test scores is .35, 
while the correlation between the grade 
point averages and the retest scores is .51. 
Although both of these correlations are 
significantly different from zero at the 01 
level of probability, the difference be 
tween the two correlations is also signifi- 
cant at the .01 level. The difference be. 
tween the mean scores on the two tests, 
however, is not significant at the .10 level, 
and the correlation between the raw scores 
made on the initial test and retest is .80, 


Conclusions 


Because, in this instance, the retest gives 
a more accurate measurement of the stu- 
dents’ mental abilities, it is suggested that 
mental ability tests used to predict school 
achievement not be administered at the 
beginning of school but rather after school 
has begun. Such test results should be as 
accurate as possible if the counseling is 
to be effective in helping the student to 
set up realistic goals. 
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The BIS Dependency Scale and Grades in 
Psychology Courses’ 


Although the Biographical Inventory for 
Students (BIS) developed by Siegel (2) was 


1The authors wish to thank Dr. Laurence Siegel 
and Educational Testing Service their permis- 


sion to use the BIS in study. 


not intended to be a prediction device for 
academic achievement, Siegel reports (8) 
that several of the scales correlated signifi- 
cantly with grade point average of college 
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freshmen. One of these scales, the depend- 
ency scale (Dep), showed a pronounced 
curvilinear relationship with grade point 
average (eta = .48), with a tendency for 
high grades to be earned at both ends of 
the Dep continuum. This non-linear rela- 
tionship has considerable practical and 
theoretical interest, and emphasizes the 
unique, and perhaps unexpected, relation- 
ship biographical information may have 
with criteria. 

The present study relates the Dep scale 
to grades in two psychology courses. The 
purpose is to test further the predictive 
value of the scale on a more specific aca- 
demic criterion and to test further the 
validity of the unique curvilinear relation- 
ship between dependency and achievement. 


Method 


The entire BIS was administered to 62 
male students in General Psychology (in 
three different sections) and 37 male stu- 
dents in Abnormal Psychology (in two dif- 
ferent sections) at the University of Arkan- 
sas, Although the BIS had been designed 
for freshmen students, it was completed 
with no difficulty by the students in the 
present study. The students were informed 
that the experimenter was collecting bio- 
graphical information in order to compare 
students at the University with students in 
other universities. The inventory was ad- 
ministered and scored following the pro- 
cedure outlined in its manual. Only scores 
on the Dep scale were used in this study. 

For each student the number of points 
eamed on all examinations during the 
semester was totaled. His total was then 
converted to a Z-score based on the distri- 
bution of his section. The Z-scores then 
served as the criterion measure. 


Results 


The scatter diagram for Dep scores and 
Z-scores showed a definite curvilinear trend 
for both General Psychology and Abnormal 
Psychology. As in the Siegel study, there 


323 


was a tendency for high grades to be earned 
at both ends of the dependency continuum. 

The eta for General Psychology was .38, 
and for Abnormal Psychology it was .43. 
Following the procedure given by Peters 
and Van Voorhis (1), each eta was convert- 
ed to an epsilon and the null hypothesis test- 
ed. For General Psychology epsilon was .53 
(p <.01). For Abnormal Psychology epsilon 
was .49 (p <.05). 

Discussion 

The results thus support Siegel's find- 
ing, that is, Dep scores are signficantly re- 
lated to achievement and the relationship 
is a curvilinear one. This curvilinear rela- 
tionship suggests the need for further re- 
search into the nature of the personality 
factors involved. Siegel (3) suggests that stu- 
dents scoring in the middle of the Dep 
range may be more insecure than students 
scoring in the two extremes, resulting in 
lower grades. This interpretation suggests 
to the present authors that differences in 
dependency as measured by the Dep scale 
may be related to differences in anxiety 
drive level. That is, the students at the 
two extremes of dependency tend to have 
a lower level of anxiety than do students 
in the middle of the range. Considerable 
experimental evidence has indicated that on 
some tasks a high level of anxiety is detri- 
mental to performance and a low level 
beneficial. 


References 


1. Peters, C. C., & Van Voorhis, W. R. Statistical 
procedures and their bases. New 
York: McGraw-Hill, 1940. 

2. Siegel, L. A biographical inventory for stu- 
dents: I. Construction and standardization of 
the instrument. J. appl. Psychol., 1956, 40, 5-10. 

8. Siegel, L. A biographical inventory for stu- 
dents: II. Validation of the instrument. J. appl. 
Psychol., 1956, 40, 122-126. 


Donald H. Kausler 
Neal D. Little 
University of Arkansas 





Journal of Counseling Psychology 
Vol. 4, No. 4, 1957 


Letters to 
To the Editor: 


I should like to comment on an idea 
expressed by both Dressel and Stroup in 
the last Journal. I hope the fact that it 
appeared twice in the same issue does 
not mean that it represents a trend. These 
authors seem to be recommending that we 
abandon or drastically modify our policy 
of keeping confidential the things our cli- 
ents tell us, so that we may improve our 
relationships with other student person- 
nel workers and faculty members. 

I am all for better relationships. I am 
also perfectly willing to admit that com- 
plicated ethical dilemmas occasionally 
arise with regard to confidentiality. But 
I feel very strongly that if we were to 
change the policy, we would be giving up 
something so essential that we would no 
longer be able to make our most important 
contribution to the total task of helping 
students develop their potentialities. 

Counselors who advocate sharing infor- 
mation with others who are interested in 
the same student usually argue the point 
on the basis of single situations that can 
be considered from more than one ethical 
point of view. What it seems to me that 
they fail to consider is the long-range 
effects of such a policy. What happens 
after a counselor talks to an administrator 
about drunkenness in the dormitory or 
tells an FBI investigator that a student 
has had homosexual experience? I feel 
fairly certain that in a very short time the 
word will get around among students. 
Information about drunkenness or homo- 
sexuality will no longer reach any coun- 
selor’s ear. The Dean and the State De- 
partment will be thrown back upon what- 
ever sources of information they had be- 
fore the counselor spoke up. The only 
real change—but it is a big one—will be 
that there is from then on no place where 
a student can come to think through his 
own values and attitudes without having 
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to be concerned about overt consequences 
of what he is saying. 

The unique and indispensable service 
that counseling provides is that it gives 
people the opportunity for such “thi 
through” in connection with all kinds of 
problems, situations, and decisions—voca- 
tional choice, personal conduct, relation. 
ships with other people. Let's not jeop- 
ardize this. It is surely possible for us to 
keep on good terms with our colleagues 
without sacrificing this central feature of 
our work. After all, they are reasonable 
people. They see the necessity for con- 
fidentiality if it is pointed out to them. 


Leona E. Tyler 
University of Oregon 





To the Editor: 


The article by Carl Rogers entitled “A 
Note on the ‘Nature of Man’” constitutes, 
I believe, a significant addition to the 
theoretical literature in the field of coun 
seling. The statement clarifies many ques 
tions which have arisen concerning Carl 
Rogers’ basic philosophy as it relates par- 
ticularly to the nature of the human ani- 
mal. The: author’s use of the personal pro- 
noun gives the reader the feeling that these 
pages are the handiwork of a fine person 
as well as the product of a luminous and 
discriminating mind. The first-person style 
of the article, enjoyable as it is, perhaps 
makes it inconvenient to elaborate all 
points in sufficient detail. At the risk of 
seeming to cavil, therefore, may I raise 
some issues which seem to be incompletely 
resolved. 

Rogers questions, at one point, the com- 
parison of his own philosophy with that of 
Rousseau and the thinking of Freud with 
that of Augustine. He says “I am somewhat 
skeptical of the value of thus putting very 
different people into the same pigeonhole. 
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[ believe it might be of greater value to 
look separately at Augustine or Freud, 
Rousseau or myself, rather than to lump 
any two of them together” (1, p. 199). Cer- 
tainly it is never permissible to lump “very 
different people” into the same category 
if these people are very different on the 
basic characteristic under consideration. 
The principle of classification, however, as 
[am certain Rogers would agree, is a part 
of the very nature of scientific generaliza- 
tion. My attempts at classification derive, 
therefore, not from any basic disrespect for 
the uniqueness of the individual points of 
view but rather for the need, scientifically, 
to place related experiences and perspec- 
tives together for consideration and analy- 
sis. Rogers prefers to class Freud with Cal- 
vin. Others may prefer to find relationships 
between the insights of Rogers and some 
great thinker other than Rousseau. The 
comparison, respectively, of Augustine and 
Freud, Rousseau and Rogers, seems to me 
to be meaningful in the context presented. 
[hold no additional brief for the classifica- 
tion. 

When Rogers indicates that he has not 
tread extensively in the writings of Rous- 
seau, he does not intend, I am certain, to 
overlook the myriad and subtle ways in 
which ideas are communicated from in- 
dividual to individual and from generation 
to generation. When we reflect, our minds 
echo with half-remembered voices; and 
when we write, our pens move to the touch 
of unseen hands. 

When discussing his propositions con- 
cerning the nature of man, Carl Rogers 
begins with some statements declaring 
what he does not discover man to be in his 
basic nature. At one point he states, “I do 
not discover man to be well characterized 
in his basic nature by such terms as funda- 
mentally hostile, antisocial, destructive, 
evil.” He also writes, “I do not discover 
man to be essentially a perfect being, sadly 
warped and corrupted by society” (1, p. 
200). We are still left then with the ques- 
tion “Whence do man’s problem behaviors 
derive?” If they do not come from his basic 
nature as an individual then, it would seem, 
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they must arise at the supraindividual 
level (2, p. 90). 

Finally, the use of the animal analogy 
to clarify the behavior of human beings is 
pleasing and, on the surface, convincing. 
The more one reads over the passage, how- 
ever, the more hazardous it seems to argue 
concerning human beings from analogies 
with the animal world. When I think of the 
many unflattering things which can ap- 
propriately be said, at times, about human 
behavior and when I compare them with 
the exemplary behavior of lions, the thought 
occurs to me, with apologies to Walt Dis- 
ney, that the lions scarcely seem human. 


Donald E. Walker 
San Diego State 
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To the Editor: 


We must thank Messrs. Walker and Peif- 
fer (4) for “The Goals of Counseling” in 
the fall issue of your Journal. Their picture 
of moral chaos and its attendant lack of 
direction in the counseling situation strikes 
us as singularly apt. The article indeed 
would have been better called “The Lack 
of Goals in Counseling.” General dissatis- 
faction is abroad in the field today and 
nothing illustrates this better than the trend 
in current articles toward discussion of 
ethics and morality in the counseling situa- 
tion. Mowrer’s (1) despair with the results 
of present methodology and concurrent 
theory leads him to speculate as to the 
conceptual promise of religion. The value 
implications are obvious. Similarly, Moyna- 
han (2) in a recent review of the literature 
concludes that “The current developmental 
focus of guidance is assuming a broader 
concept of man which includes his ethical 
and spiritual dimensions.” 

The dissatisfaction prompts us to find 
an analogue for the current situation in 
that of Socrates’ Athens. There too, the 
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sages, advice-givers, counselors of youths 
swallowed so much relativist psycho-phi- 
losophy that they choked on it. The Soph- 
ists, Protagoras and Gorgias, preached cul- 
tural relativism; they too, prided them- 
selves on exploding the myth of the abso- 
lute. Standing among them, influenced by 
their teaching, yet ultimately opposed to 
cultural relativism, Socrates insisted upon 
an eternal. “Know thyself” has its perti- 
nence today. This search for a stabilized 
value structure having universal applica- 
tion tends to resolve the “arbitrariness” of 
this dilemma, but it has yet to satisfy the 
criticisms of our naturalistically oriented 
colleagues. Shoben (8) strikes something 
of a middle ground by rejecting an ex- 
clusively relativistic approach and postulat- 
ing a basic principle of value based on 
man’s unique nature, The resultant norm1- 
tive model is nevertheless a product of 
cross-cultural influences. 

The counselor of today is in no sense a 
teacher, nor a constructor of values; his 
function is, as we see it, to provide the 
conditions for exploration. He is, or should 
be, fully aware that the democratic (a 
changing dynamic term used here in its 
loosest sense) context in which he lives 
imposes upon him the relativistic spirit. His 
gains with respect to his client are meas- 
ured in terms of his penetration into the 
orbits of that client’s personality and his 
ability to bring the client to a point of 
self-awareness. It is at this point of self- 
insight that the satisfactory resolution of 
conflicts are presumably achieved. 

This naturally imposes a set of values 
upon the counselor-client situation. Self- 
seeking may uncover hostile destructive 
tendencies. Can the counselor remain, then, 
impartial? Is he so much a function of his 
client that he then cannot remain apart 
from the hostility and destruction? We 
seriously doubt it. He has responsibilities 
and duties to employer, institutional 


groups, as well as to political and economic 
units. These he recognizes, but as coun- 
selor, he has certainly come to grips with 
conflicts among these areas by virtue of his 
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own position in society. His relatio 
with the client will at point of insight 
necessarily alter from the inner-directed 
self-exploration of the client to an outer. 
directed examination of possibilities. It is 
at this point that the counselor qua coun- 
selor ceases to function. It must be as 
sumed that the client behavior which fol- 
lows with respect to the resolution of con- 
flicts, selection of goals, or the evolution 
or reconstruction of values from the most 
concrete (J. J.’s immediate relationship 
with the boss) to the most abstract (J. Js 
relationship to social, political and even 
ethical relationship at large) will necessar- 
ily be improved. 

The counselor cannot succeed in every 
case. In every case, however, he can tum 
to positive values implicit in his client's 
view of the world. Attitudes that build 
he will underscore. Generally, what may 
these attitudes be? Certainly a positive at- 
titude towards man’s essentially construc 
tive drives, toward creating, improving, 
procreating. Specifically they will vary with 
each client. The other side of the coin 
implies the awareness of man’s common 
hostilities and destructive attitudes. The 
client, aware that he and his fellows (in 
cluding the counselor) have a common 
enemy within themselves, and that he and 
they (we) have a duty (we prefer the 
old-fashioned term) against it, is certainly 
the goal toward which the counselor strives. 


Sidney J. Black 
and Vincent F. Calia 
Boston University 
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Test Reviews 


Laurence Siegel 
Miami University 


This department of the Journal of Coun- 
seling Psychology is now one year old, A 
birthday seems like a particularly good 
time to examine the past and to raise ques- 
tions about the future. 

The four previous appearances of Test 
Reviews contained critical summaries and 
evaluations of eight psychometrics. Three 
of these instruments measure in the area 
of intellectual ability and achievement; 
four measure in the area of personality and 
interest; and one is a miniature battery for 
instructional rather than operational appli- 
cations. Seven of these eight instruments 
are of potential interest to persons con- 
cemed with counseling and/or instruction 
at the adult level (including high school 
and university students) whereas one is of 
particular interest only at the primary 
grade level. Each review has been relative- 
ly lengthy in keeping with a policy to re- 
view relatively few tests in a fairly pene- 
trating and explicit manner. 

What directions should be taken by this 
department in the future? Has the cover- 
age been adequate or have specific tests 
and inventories been unjustly omitted? Is 
the representation of psychometrics suf- 
ficiently comprehensive or should more 
space be allocated to measures at particu- 
lar age and educational levels? Are the re- 
views too long, or too detailed or too any- 
thing else? 

A Section Editor remains blissfully ignor- 
ant of deficiencies unless he hears directly 
from the readers. The invitation, extended 
at the inception of the department, to offer 
suggestions for improvement has been 
singularly unproductive. It must be con- 
cluded that (1) readers are dissatisfied but 
inertia prevents correspondence; or (2) read- 
ets are generally pleased and have few 
suggestions to offer; or (3) there are no 
readers. Assuming that there are readers, 


our knowledge about individual differences 
would seem to indicate that some of them 
would be unhappy about maintaining the 
status quo. Consequently, you are hereby 
again encouraged to call my attention to 
recently published tests and inventories 
especially worthy of discussion in this sec- 
tion. Furthermore, if you wish to comment 
upon or to differ with any of the reviews, 
you are invited to write up your own re- 
view of the instrument in question and to 
send it in to me. Such counter-reviews are 
earnestly sought and will be represented 
in the Journal with the understanding that 
space limitations necessitate reservation of 
editorial license. 





G. K. Bennett, Marjorie G. Bennett, W. L. 
Wallace and A. G. Wesman. College 
Qualification Tests: The Psychological 
Corporation, 1957. 


The College Qualification Tests (CQT) are 
measures of ability developed for use by colleges 
in admission, placement and guidance procedures. 
High school counselors will also find the battery 
helpful in advising students who have college 
aspirations. 

The COT are, in reality, three separate meas- 
ures: vocabulary (synonyms and antonyms), nu- 
merical (arithmetic, algebra and geometry) and 
information (science and social science). In addi- 
tion to yielding scores on each of these tests, the 
COT provides a total score across tests as well as 
separate scores on the Science Information and 
Social Science Information subtests. The battery 
is timed for 95 minutes, including administration. 
It is, however, primarily regarded as a power 
rather than as a speed series. 

Two equivalent forms of the COT are current- 
ly available. Form A is distributed to both sec- 
ondary schools and colleges. Form B is restricted 
to college use in order to maintain security for 
those institutions desiring to use the tests as a 
partial basis for selecting students. It is anticipated 
that the policy of maintaining at least one re- 
stricted form will continue as the series undergoes 
revision. 
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Statistical Characteristics 


The COT were clearly intended to accomplish 
somewhat the same objectives as do tests like the 
ACE and SCAT. Correlations between total score 
on the COT and total scores on the aforemen- 
tioned instruments range between .77 and .82. In 
view of the substantial communality of these 
tests, it is doubtful that the COT can be regarded 
as a supplemental measure. When used, it should 
probably replace other predictors of academic 
success in the testing program. The matter of the 
desirability of such replacement aside for the mo- 
ment, the COT manual contains tabular material 
which will facilitate the transition from use of the 
ACE or SCAT to use of the COT. These tables 
list “equivalent scores” for the three instruments: 
i.e., raw scores are paired by percentile conversion. 
Such data should prove particularly helpful during 
the interim period when an institution would 
have CQT records for some students and ACE 
or SCAT records for others. 

Is there, however, any specific justification for 
superseding either the ACE or the SCAT with the 
CQT? Although predictive validity of the battery 
against the criterion of first semester grade-point- 
average is very good, the CQT is probably no 
better in this respect than either of the afore- 
mentioned instruments. Since validity is specific 
to given institutions, a tryout seems advisable be- 
fore making a decision to accept or reject COT 
on the basis of predictive validity. 

Estimates of reliability (defined as internal con- 
sistency) of each of the three component tests are 
uniformly high. Coefficients for the Science and 
Social Science portions of the Information Test, 
however, range between .78 and .84. Thus, the 
authors recommend that these subtests be used 
for the purpose of studying group rather than 
individual performance. 

The normative group was sizeable, consisting of 
more than twenty-four thousand newly admitted 
students in thirty-seven colleges and universities. 
The size of the total sample made possible the 
very useful presentation of separate percentile 
norms by type of college (state supported vs. pri- 
vately controlled) and by type of curriculum 
(A.B. degree, B.S. degree, degree in business, 
education, engineering, technical courses, and 
nursing). 


Summary 


The COT is an ability battery at the high school 
senior-college freshman level. It consists of three 
tests, two of which (verbal and numerical) are 
much like those found in other instruments de- 
signed to predict academic success. The unique 
contribution of this battery appears to be in the 
third test, identified as Information. Scores on the 
science and social science information subtests 
combined with scores on the Verbal and Numeri- 
cal tests should prove a helpful adjunct to the 


Laurence Siegel 


counseling process. Further, such subscores may 
well assist with the identification of advanced 
students for placement in “accelerated sections” 
of certain courses, when such sections are offered, 





H. H. Remmers and Robert H. Bauerfeind, 
Junior Inventory: Form S. Chicago: Sci- 
ence Research Associates, 1957. 


The Junior Inventory is a needs and problems 
checklist designed for use with fourth through 
eighth grade pupils. Form S is a major revision 
of Form A which appeared in 1951. The new 
form consists of 168 self-descriptive statements 
clustered into five areas: (1) About Me and My 
School, (2) About Me and My Home, (8) About 
Myself, (4) Getting Along with Other People, and 
(5) Things in General. The authors advocate the 
use of the Junior Inventory for a wide variety of 
purposes, including both counseling and research. 
To the extent that this inventory will be used by 
teachers and counselors as an evaluational tod 
for the purpose of stimulating discussions with 
students, it will serve a very useful purpose. I 
is doubtful, however, that the Junior Inventory, 
in its present form, deserves the refinements of 
scoring and profile analysis also suggested by the 
authors. The statistical rationale underlying the 
development of this inventory is simply too weak 
to justify the derivation and interpretation of 
“scores” for the five subscales. 

Considered as an evaluational checklist rather 
than as a measuring instrument, the Junior Inven- 
tory possesses tremendous potential for application, 
The items in the inventory are phrased in the 
youngsters’ jargon since most of these items were 
extracted from “My Problems” essays written by 
elementary school children. The format of the 
booklet is ingenious in providing a readily com- 
prehensible system for rating each of the self- 
descriptive statements as a “big problem,” “mid- 
dle-sized prublem,” “little problem” or “not 4 
problem.” By and large, the manual is well writ- 
ten and will be understandable to persons who 
might be required to administer the inventory in 
the absence of any specialized training in testing 
procedures. Finally, the instrument may be ad- 
ministered to groups of pupils in a relatively 
brief period of time (80 to 45 minutes), There 
is little doubt that the perceptive teacher, and 
counselor, will gain much in the way of 
information about individual pupils by studying 
their replies to specific items. Analysis of group 
responses to specific items (i.e., problems) may 
provide a sound basis for evaluating the school’s 
success in achieving nonacademic objectives and 
may well stimulate classroom discussions consti- 
tuting a mental hygiene program at the elemen- 
tary school level. These are, however, the limits 
of application of the Junior Inventory. Statistical 
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considerations, as discussed below, prohibit prop- 
et interpretations of scores on the five subscales. 


Statistical Characteristics 


The starting point for development of clusters 
or subscales within the Junior Inventory rested 
upon the frequently used procedure whereby 
provisional clusters are hypothesized and items 
are grouped into these provisional clusters for 
the purpose of deriving subscores. The alloca- 
tions of items is then verified by correlating every 
item with every provisional subscale. The result- 
ant item-cluster correlations normally dictate the 
removal of certain items and the reassignment of 
others. 

Unfortunately this procedure was aborted in 
the development of the Junior Inventory. The 
empirical portion of the item analysis was not 
iterated because the authors somehow established 
a rationale which prevented the expected mo- 
bility of items. This rationale is not clarified in 
the manual, but it is quite obvious that certain 
clusters were permitted to retain items which did 
not correlate substantially with the rest of the 
subscale! The “Myself” cluster, for example, con- 
tains at least one item with a 0.00 correlation. 
How many such items were retained to contam- 
inate the subscales is not discussed in the manual. 

Furthermore, a usual procedure in this type of 
analysis is to retain only those items which cor- 
telate significantly with one or perhaps two of 
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the subscales. The magnitudes of intercorrelations 
between the subscales are sufficiently high to in- 
dicate that the Junior Inventory contains many 
items which correlate with several subscales. In 
fact, the authors’ contentions that the intercor- 
relations between the five areas “. . . are satis- 
factorily low to justify treating each area as an 
independent measure” is probably untenable. 
These intercorrelations range between .389 and .77 
with a median value of .52. Although the data 
were not factor analyzed, it is probably that one 
general factor would account for a large portion 
of the total variance. And two factors, combin- 
ing the “School” and “Home” clusters and the 
“Myself” and “People” clusters would probably 
remove virtually all of the variance. 

Thus, the data now available on the Junior 
Inventory do not justify compution of the five 
subscores advocated in the manual. Furthermore, 
since predictive validities have not yet been 
demonstrated, it is unlikely that one would want 
to score the inventory anyway. 


Summary 

The Junior Inventory is a valuable supple- 
ment to general evaluational techniques in the 
area of personality at the elementary school level. 
When considered in this light, it has excellent po- 
tential. It is unlikely, however, that it can be 
treated as a multi-scored measuring instrument 
at the present time. 
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Benton J. Underwood, Psychological Re- 
search. New York: Appleton-Century- 
Crofts, 1957. Pp. 295. 


It has been said that criticism is inherently in- 
teresting and praise dull. If this be true, it will be 
difficult to write a lively review of Underwood's 
Psychological Research. Here is simply a delightful 
book. And if this laudatory statement is sufficient 
to move you to read the book, then read this 
review no further. The review will get dull in a 
way the book never does. 

Underwood offers a course at Northwestern 
University listed in the catalogue as Scientific 
Method in Psychology. These are his lectures. 
They range from considerations of basic problems 
in the philosophy of science, such as the nature of 
scientific explanation, to the detailed analysis of 
the adequacy of design of specific experiments 
that have been reported in the literature. The 
emphasis is not on design per se but on the logic 
of inquiry, on the appropriateness of drawing 
particular conclusions on the basis of particular 
operations. Common faults are made real not by 
abstract admonition but by specific citation. The 
discussion of explanation in psychology is re- 
warding at once for its sophistication and its 
simplicity; Underwood is unabashed in his assump- 
tion that the purpose of science is to further under- 
standing of nature through explanation, yet he is 
aware of the complexities of the problem that 
have led other writers to an evasive confound- 
ing of purpose and method seen in such a vacuous 
statement (from a popular elementary text) as: 
“The ultimate aim of the psychologist is to make 
predictions about behavior.” Underwood rides 
some hobbies (such as the desirability of post-hoc, 
multiple analysis of data), and at some points 
(such as in the definition of Level-8 concepts) his 
usual clarity fuzzes a bit. In other words, the in- 
structor using the book can still earn his salary. 
Though the book is wide ranging, it has a coher- 
ence frequently missing in a collection of lec- 
tures. 

Ordinarily it is not good book-reviewing man- 
ners to write ad hominem. Personal allusion is per- 
haps justified here because the tone is apprecia- 
tive and because the author himself chooses to 
write in the first person. Much of the delight of 
the book comes from Underwood’s presence in it. 
The reader will like him. He is knowledgeable. 
He is toughminded but with overtones of that 
idealistic commitment so characteristic of many 
non-applied psychologists. He is opinionated, per- 
suasive, and not above punning. He writes well; 
he is as intolerant of an untidy sentence as of an 


untidy research design. He takes himself 

enough to be taken seriously by others, but is 
not pompous. He is a working scientist who has 
maturely reflected upon what he is about, and 
he generously shares his convictions with others, 

A central concern of departments of psychology 
over the country is the training of competent re. 
search people. At one point, in discussing the 
mastery of a basic principle of research design, 
Underwood comments: “In order to learn we must 
practice and practice and practice.” But practice 
is surely not enough. Knowledge of results is es- 
sential, and good models to emulate should speed 
the learning process. Underwood's book should 
heighten our awareness of good and poor pro 
cedures, and, perhaps more important, make of 
many of us better models for our students. 

And now, to those who have kept slogging 
through this enthusiastic review, there’s far richer 
fare ahead, with its own enthusiasms, to be sure, 
but with a good measure too of fine critical com- 
mentary—and it is never dull. 

Nicholas Hobbs 


Peabody College 


Percival M. Symonds, Dynamics of Psycho- 
therapy, Vol. II. Process. New York 
Grune & Stratton, 1957. Pp. xiv + 1% 
—398, 


The book under consideration is the second 
volume of a three-volume work for which the 
stated aim is “to present a comprehensive survey 
of the principles, process, and procedures of psy- 
chotherapy for use as a text by students training 
for skill im psychotherapy in the several profes- 
sions where its use is a method of helping in 
dividuals who seek help for personal problems.” 
How well does it carry out this purpose? 

One’s first impression is that it is a somewhat 
arid “textbookish” exposition of the principal 
psychoanalytic concepts—transference and countet- 
transference, resistance, abreaction, and insight. 
As such it might be useful to students who get 
lost in the lush vegetation of the books the analysts 
themselves write. Simple definitions are given at 
the beginning of the chapters, and sections are 
devoted to differentiating one concept from others 
that are similar in general meaning. Then each 
idea is elaborated, primarily by means of quota- 
tions from a large number of writers who have 
discussed it, 

One’s second impression, as he gets into this 
elaboration, is one of considerable confusion, This 
seems to arise from several sources. As the author 
enlarges on each concept, its meaning changes 
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from section to section. The change is in breadth 
or scope as well as in detailed significance. Each 
concept at times tends to spread out until it alone 
is synonymous with the whole process of therapy. 
In discussing abreaction, for example, the author 
om pages 328-330 lists almost all varieties of emo- 
tional experience—work, success, enjoyment of art 
and nature, religious observances—as varieties of 
abreaction. On page 330, immediately opposite, 
we find the heading “Abreaction Must Be Inter- 
personal” followed by a paragraph explaining that 
mless feelings are expressed, preferably to a 
therapist, they are not abreaction. On page 316 
we read that abreaction is the essential agent in 
therapy. On page 333, a considerable number of 
presumably treatable conditions are listed for 
which abreaction as a form of therapy is contra- 
indicated. Numerous examples of the same sort 
could be given for all the other main ideas. 

Another source of confusion is the inclusion in 
this predominantly Freudian framework of ideas 
of neo-Freudians and nonpsychoanalytic writers 
such as Rogers, without any attempt to show that 
their concepts rest on different theoretical founda- 
ions from the others. An example again will in- 
dicate what is done repeatedly. After a very non- 
Rogerian statement on page 339, that “a large 
part of the skill of the psychotherapist consists in 
diagnosing false perceptions . . . ,” the author 
in the next chapter lists as changes that take place 
with insight all of the changes Rogers has dis- 
cussed as outcomes of successful client-centered 
therapy. The point is that with the methods Sy- 
monds specifies are to be used: by the therapist, 
we would not necessarily expect the changes Rog- 
as gets with quite a different method. The things 
various people have said about psychotherapy are 
all thrown in together with no consideration of the 
question as to whether or not they are compatible 
with one another. 

In. summary, one might say that while there 
are many good ideas in this book, they have not 
been adequately digested and assimilated. It would 
help the inexperienced student to become sensitive 
to the complex meanings that even simple be- 
havior may express. But as a complete text on 
psychotherapy it falls far short and could well be 
more misleading than informative. Perhaps at the 
present stage of knowledge of psychotherapy, such 
a comprehensive text is an impossibility. At any 


tate, this is not it. 
Leona E. Tyler 
University of Oregon 


M. Eunice Hilton (Ed.), Guidance in the 
Age of Automation. Syracuse, New York: 
Syracuse University Press, 1957. Pp. 94. 


This publication consists of a series of lectures 
given at Syracuse University in connection with 
the celebration of the twenty-fifth anniversary 
of the establishment of a training program in 
student personnel work at that institution. 
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The participants in this symposium were Lillian 
M. Gilbreth, Finla G. Crawford, Frank P. Piskor, 
Esther Lloyd-Jones, C. Gilbert Wrenn, Walter A. 
Taylor, Marion T. Melcher, Lois M. Gould, and 
M. Eunice Hilton. 


Lillian Gilbreth urged that we plan carefully 
for the age of automation so that the machine 
remains the servant and does not become the 
master of man. Crawford’s paper concerned itself 
primarily with the problems of housing on a uni- 
versity campus. Piskor called attention to the 
need for research studies of the campus community 
as a basis for a more effective student personnel 
program. : 

In her first lecture Lloyd-Jones presented a 
thoughtful discussion of the impending increase 
in the school population and its effect upon the 
program of guidance services at all levels. She 
called particular attention to the need for develop- 
ing better guidance services at the elementary 
level and to the importance of providing these 
services to all pupils, not just to special groups 
such as the gifted and the handicapped. Lloyd- 
Jones criticized the tendency in schools today of 
employing “guidance specialists” whose practice 
is “to divide the problem up” and not to face the 
student as a “whole person.” Her preference in 
the guidance program is for a group approach 
which is interested “in building around each child 
a situation in which he could grow.” To this re- 
viewer, the emphasis on the “group process” is 
nothing more than a plea for good teaching and 
it illustrates the confusion that exists today in the 
use of the term “guidance.” This confusion will 
continue until we separate out the individual 
pupil personnel services from the total educative 
process and set up training programs to reflect 
this distinction. As the situation exists today you 
can never tell when the term “guidance” means 
personalized teaching and when it refers to in- 
dividual services to pupils. To call these two dis- 
tinct services by the same name does not make 
for effective educational practice. 


In Lloyd-Jones’ second article she contrasted 
specialized guidance services with what she called 
“integrated” practices in the personnel program. 
She writes: “I do not believe that counseling lies 
any longer in the frontier of personnel work” and 
goes on to emphasize the need for more group 
procedures. As a reviewer, I see no need to set 
up these personnel functions in a competing, 
either/or relationship. It is obvious that in an ef- 
fective personnel program there should be a strong 
group activity emphasis, but that does not exclude 
the necessity for a carefully planned program of 
individual services to pupils. These services are 
complementary, not competitive. 

C. Gilbert Wrenn, in his first lecture, presented 
a thoughtful review of some of the more recent 
research and writing in the field of emotional 
problems in counseling. He followed this with a 
nicely-drawn distinction between “teaching” and 
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“counseling” by means of which he avoided the 
pitfalls inherent in the use of the term “guidance” 
to cover both of them. He also called attention 
to the importance of working with the student’s 
strengths as well as his limitations. 

In his second paper, Wrenn presented first a 
brief history of the development of student person- 
nel services in this country and then proceeded 
to a consideration of the nature of the work of 
an administrator of student personnel services. 
He called attention to T. R. McConnell’s caution 
against permitting student personnel services, par- 
ticularly counseling, to become isolated from the 
main stream of college life. Wrenn pointed out that 
it is the responsibility of the administrator of stu- 
dent services to plan his program so as to guard 
against this. 

Walter Taylor is a licensed architect who has 
interested himself in student housing and shows 
a surprising familiarity with the philosophy and 
objectives of student personnel work. A university 
is indeed fortunate to have an architect on its 
staff with such insight into the personnel program. 
Persons in charge of student housing will read 
Taylor’s paper with considerable profit. 

Melcher’s two articles are concerned with the 
personal problems that the college student health 
service meets from day to day. Gould, in her first 
lecture, discussed the teacher as a counselor 
and in the second one she outlined the steps neces- 
sary to guarantee a smooth transition of the stu- 
dent from high school to college. 

An excellent summary and recapitulation of the 
sessions is presented by Eunice Hilton who also 
evaluated some of the current theory and practice 
in student personnel work. 

While this publication does not tell us very 
much about the “age of automation” other than 
to say that as far as guidance is concerned we 
are likely to have much more of what we already 
have, yet it does make a serious effort to look 
ahead and that is a healthy outlook. This type of 
publication is comforting in that it is evidence 
that capable and devoted people are giving time 
and energy in this “age of automation” to make 
certain that every pupil in our schools is treated 
as a person and not merely a target for instruc- 
tional shotguns. 

Hugh M. Bell 
Chico State College 


Norman R. F. Maier, Allen R. Solem, and 
Ayesha A. Maier, Supervisory and Ex- 
ecutive Development—A Manual for Role 
Playing, John Wylie & Sons, 1957. 330 pp. 
These authors propose that executives and super- 

visors need training of a kind that goes beyond 

the mere learning of abstract principles of human 
behavior. These learning principles are regarded 
as having little value because the difficult prob- 
lems that arise in the daily course of business af- 
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fairs are usually emotionally laden with the execu. 
tive or supervisor himself involved in the problem, 
Under these conditions they need training of a 
different sort before they can see the application 
of these principles to the specific situation. The 
training proposed is role playing. 

This book is made up of 20 actual cases based 
on conflicts which have occurred in various in 
dustrial settings. Each case typifies a unique type 
of management problem and highlights methods 
or techniques for dealing with them. Each also 
has a strong interest value and makes absorbing 
reading. With each case the problem is first fo 
cused by a general description of the type it 
represents. The specific situation is then described 
to illustrate this type of problem. The role playing 
procedure is presented step by step for each of 
the characters involved in the play. The author 
also include questions and discussion topics to 
facilitate the subsequent analysis and to enable 
the participants to focus on the essential issues 
involved. The last section of each case contains 
an analytic commentary of the problem high 
lighting the implications of the various principles 
involved. 

The authors firmly believe that their book can 
be used as a training manual by small groups 
with or without a trainer or even for executives 
seeking self-development. It is their experience 
and belief that role playing, being essentially a 
play situation, allows the participants to experi- 
ment and try out new methods of handling con- 
flicts without running the risk that real life prob- 
lems present. The tacit assumption is that with 
practice, play situations will transfer and make the 
supervisor more effective in dealing with the real 
problems that come up. Also the opportunity to 
practice, discuss, and analyze crucial issues in a 
role playing situation allows the salient features 
to emerge and gives the participants experience 
in uncovering basic issues that always hide behind 
the expressed claims and counterclaims of the 
disputants. 

The book avoids giving ready-made ~ answers 
to any of the cases presented, emphasizing the 
need for developing skills in the process of solv- 
ing or preventing problems rather than the cook 
book variety of finding answers to ready-made 
situations. 

Many of the cases appear to deal with relatively 
deepseated problems of the kind that require the 
skill of an expert counselor. One cannot help 
wondering whether the average foreman or super 
visor found in an industrial plant could, even 
through practice in role playing, learn to de 
velop the necessary skills to probe, uncover, and 
resolve these issues. 

It still remains to be shown that role playing as 
a technique enables the participants as well as 
the observers to develop the needed skills and 
understanding for more effective supervisory de 
velopments. For those who are partial to role play- 
ing as a training device or who seek better under 
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sanding of what this technique entails, this book 
will prove most helpful. 


Jacob Berg 
Vocan Corporation 
Minneapolis 


National Science Foundation, Education 
and Employment Specialization. Wash- 
ington: U. S. Government Printing Office, 
1955, 78 pp. 


National Science Foundation, Scientific Per- 
sonnel Resources. Washington: U. S. Gov- 
ernment Printing Office, 1955, 86 pp. 


Educational Policies Commission, Man- 
power and Education. Washington: Na- 
tional Education Association, 1956, 128 


Pp. 

It may not yet have occurred to counselors and 
vocational guidance workers that our governmental 
and social agencies are concerning themselves in- 
creasingly with a significant facet of the occupa- 
tional scene which seems rarely to have excited 
the psychologist. While the latter continues his 
familiar and comfortable preoccupation with such 
topics as vocational choice theory, the genesis of 
vocational interests, and the use of multi-factor 
tests in counseling, other social scientists are rais- 
ing some searching questions about the effective 
use of American manpower to meet the insistent 
demands of national security and of a rapidly ex- 
panding economy. Inspection of the contents of 
this group of reports should be enough to con- 
vince vocational psychologists that not everyone 
with an interest in problems of occupational ad- 
justment sings the same tune. One finds here al- 
most nothing about psychometric appraisal, coun- 
seling technics or the prediction of vocational suc- 
cess. He discovers, instead, a sharp focus upon 
the demographic, training, and economic proper- 
ties of the American labor force. 

Whether because of their peculiar distaste for 
occupational information or some other reason, 
psychologists would seem to have made few tech- 
nical contributions to the type of manpower issues 
dealt with in these reports. (One exception is Dael 
Wolfle whose well-known America’s Resources of 
Specialized Talent is cited by all three publica- 
tions reviewed here.) In these reports two psycholo- 
gists, Harold Goldstein of the U. S. Bureau of 
Labor Statistics and Herbert Conrad of the U. S. 
Office of Education, served on an advisory panel 
of the National Science Foundation and appear to 
have assisted in their preparation. It would be 
reassuring in these publications to find the use of 
a psychologically-based (i.e. functional) occupa- 
tional classification system in the tabular report- 
ing of employment and training data or to read 
of new, empirically derived methods for the 
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counseling of the intellectually gifted. But noth- 
ing of the sort is suggested. 

Yet what may most alarm counselors about the 
reports reviewed here is not their failure to em- 
ploy new psychological tools but their tacit avowal 
of a precept generally unacceptable to those who 
work professionally with the personal problems of 
others. The emphasis in all three reports is upon 
national security rather than upon individual wel- 
fare, upon the potential contribution of the in- 
dividual to the needs of the state rather than 
upon the state’s obligation to the fullest develop- 
ment of the creative promise of its youth. The 
nation’s case is rather tersely put in Scientific 
Personnel Resources, where, in the introduction, 
one reads, “It has become apparent that the scien- 
tific and technical resources of certain other 
countries are rapidly approaching ours in numbers, 
with the indication that we may be surpassed 
within the next few years. In our effort to main- 
tain superiority we must give attention not only 
to the training of adequate numbers of scientists 
and engineers, but of even greater importance, we 
must place heavy emphasis on quality.” Only Man- 
power and Education concedes that national wel- 
fare and individual welfare need may conflict 
and that our solemn task is reconcile the two. 
Again and again, the Educational Policies Com- 
mission warns that national security must not be 
achieved at the price of individual development 
and freedom, but inasmuch as it manages to set 
forth no clear formula for the maintenance of safe- 
guards, teachers and counselors will take cold com- 
fort from its admonitions. 

1. Education and Employment Specialization 
is the second part of a two-part government sur- 
vey of college graduates. Wolfle’s book, mentioned 
above, documented the findings of the first part. 
This sequel studies the 1952 status of graduates 
who earned bachelor’s or master’s degrees in June 
1951. The raw data were derived from a follow-up 
of more than 40,000 bachelor’s degree graduates 
and more than 8,700 master’s degree graduates 
representing 1,038 institutions of higher education. 
One brief chapter of the report devotes itself to the 
sampling techniques involved in the survey and 
one notes that the presentation of findings and 
interpretations in subsequent chapters conforms 
judiciously to the conditions and limitations of the 
sampling. The scholastic specialization of subjects 
in the survey sample and their employment status, 
specialization and annual earnings one year 
graduation are meticulously presented in the body 
of the report. Thirty-eight pages of classified tabu- 
lar data are appended and this cache is richly 
enough laden with facts about our recent college 
graduates to nourish the statistical hunger of all 
but the most ravenous numerophiles among us. It 
is possible here to recite only a few of the find- 
ings which are relevant for counselors and voca- 
tional psychologists. 

The majority of respondents who were employed 
one year following graduation were in education- 
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relation positions. It came as something of a sur- 
prise to this reviewer, particularly in the face of 
the common criticism that today’s teachers are 
poorly trained in their respective subject-matter 
fields, to learn that large numbers of secondary 
school teachers did not major in professional edu- 
cation but rather in the field of specialization in 
which they were teaching. Of all bachelor’s de- 
gree holders who were continuing their education, 
only one-half were studying in the same field as 
their undergraduate major. Virtually all employed 
graduates who had majored in the engineering 
branches held jobs related to the fields of their 
college specialization. By contrast, very few em- 
ployed graduates who had majored in the social 
sciences, humanities, arts and English were found 
to be working in their fields of preparation at the 
time of the survey. The study yielded two findings 
in support of our common presumption that em- 
ployment in professional psychology depends upon 
training beyond the baccalaureate. First, among 
all undergraduate major fields covered by the 
survey, psychology produced the highest percent- 
age (89%) of bachelor’s degree holders who con- 
tinued as full-time students. Secondly, bachelor’s 
degree holders who had majored in psychology 
and subsequently entered the labor market were 
employed chiefly in business and commerce rather 
than in professional psychology. Each reader of 
Education and Employment Specialization will 
find in the potpourri of facts which this report 
serves up his own favorite assortment of quotable 
statistics concerning the training and employment 
status of our American college graduates. 

2. Scientific Personnel Resources summarizes a 
wide assortment of facts about personnel trained 
in the sciences and technologies. Prepared by the 
National Science Foundation, it does not present 
original data but draws upon selected findings 
compiled by the U. S. Office of Education, the 
Bureau of Labor Statistics, the National Research 
Council and other agencies. The principal con- 
cerns of the document are indicated by its major 
sections, namely, The Growth of Science and 
Technology, The Supply and Utilization of Scien- 
tists and Engineers, The Professional Characteris- 
tics and Employment of Scientists and Engineers, 
and the Educational System and the Training of 
Scientists and Engineers. At several points, there 
are references to the data reported in Education 
and Employment Specialization. 

It is something of an eye-opener to learn from 
Scientific Personnel Resources that there are only 
about seventeen- to twenty-thousand trained physi- 
cists in all of the United States and that, of these, 
28 per cent are at the bachelor’s degree level or 
below! The figures for trained mathematicians are 
even less impressive. In contrast, a technology such 
as chemical engineering numbered an estimated 
forty thousand workers in 1951. Seen in the 
light of this kind of information, the pleas made 
by scientific leaders for increased federal support 
of the basic sciences becomes more understandable. 
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This report helps us, too, to re-assess some of the 
easy generalizations about the alleged unpopular. 
ity of science and science teaching as major fields 
of study. We learn that the-percentage of science 
and engineering degrees relative to all 
degrees was on the rise between 1951 and 1958 
and that the number of science doctorates hag 
roughly doubled every decade since 1900. The 
number of students satisfying certification require. 
ments for teaching high school mathematics and 
science has approximately paralleled the total 
number of bachelor’s degrees awarded annually, 
In 1954, for example, while only 1.4 per cent 
(about 4,000) of all bachelor’s degrees went to 
candidates in secondary school science education, 
the percentage had never been much higher than 
this and the moderate decline which began about 
1950 appears now to have been halted. The real 
culprits ‘contributing to the grave shortage of 
trained scientists and science teachers emerge from 
this report as (1) a sharply increased demand 
which exceeds normal supply, (2) the federal man- 
power policy in effect during World War II which 
was adverse to the long-range production of 
scientists, and (8) the lures and blandishments of 
industry which skims off large numbers of those 
trained to teach secondary school mathematics 
and science. ‘ 

There are sections in this document of rather 
immediate interest to professional psychology. In 
addressing the problem of training sufficient num- 
bers of high quality scientific personnel, the re 
port calls for the “identification, motivation and 
counseling of the more able students.” (p. 1) It is 
nowhere suggested, however, by what devices this 
ambitious order is to be filled or, indeed, that it 
may even prove to be a formidable task. Does the 
National Science Foundation pay too much homage 
to our counselors? The last part of the volume un- 
critically re-iterates the widely quoted assertion of 
the Commission on Human Resources and Ad- 
vanced Training (Wolfle’s report) that college 
graduating classes could be twice as large with 
no loss in quality. This claim is based on-the fact 
that the average AGCT score of college graduates 
is approximately 120 and the knowledge that about 
half of the high school graduates who earn AGCT 
scores at about this level or higher fail to enroll in 
college. Were a much larger portion of the var- 
iance in college grades accounted for by aptitude 
test scores of the AGCT type, this argument would 
be a lot more impressive than it is. Until we know 
a good deal more about the motives of high ap- 
titude students who fail to enter college and 
the loadings of non-cognitive factors in scholastic 
performance are more accurately computed, the 
conclusion reached in the Wolfle report is with- 
out sound warrant. To give it currency in govern- 
ment documents is to cloud an already co 
and perplexing issue in higher education. 

8. Manpower and Education is the most read- 
able and, for psychologists, probably the most 
relevant of the three publications. It is by the 
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same token less strictly factual and more hortatory 
in character than the others. Attempting to chart 
the origin and present character of America’s man- 
power dilemma, the Educational Policies Commis- 
sion underscores the implications for our schools 
and concludes with a series of sweeping yet 
reasoned policy recommendations. Technological 
and population trends are identified which have 
shaped the manpower picture; the effects of auto- 
mation upon the composition of the labor force 
are projected. The Commission makes an impres- 
sive case for the growing importance of the semi- 
professional and technical work categories and for 
the urgent need to expand training programs in 
order to upgrade personnel for these areas. Chapter 
5, Education and Career, neatly disposes of the 
over-ripe and tedious debate concerning the rela- 
tive merits of general education and career educa- 
tion. Each is part and parcel of the other, we are 
told, and full education for today’s working citi- 
zen without a generous measure of both is un- 
thinkable. A chapter devoted to guidance and per- 
sonnel services represents a simple and straight- 
forward declaration of the student personnel point 
of view and contains nothing new for counseling 
psychologists. 

Like the National Science Foundation, the Edu- 
cational Policies Commission also yields to the urge 


to exhort its readers to beat the bushes for bright | 
youths and to pack them off to college. It does 
not seem to have occurred to either group that 
some able youngsters possess rational plans for 
life which do not include advanced academic de- 
grees. The Commission’s household hints for in- 
tensifying the scholastic motivation of such per- 
sons are, to put it charitably, as yet untested. For 
this reviewer, Manpower and Education speaks 
with greatest authority when it confronts the criti- 
cal issue of the teacher shortage. The National 
Education Association estimates that the present 
annual yield of new elementary and secondary 
school teachers is about 90,000. Yet, the predicted 
annual demand for new teachers during the decade 
1955-1965 is set at between 125,000 and 150,000. 
Armed with information of this kind, the Educa- 
tional Policies Commission incisively sets out a 
series of worthy proposals for tapping new sources 
of teacher supply and for reducing turnover among 
existing teaching personnel. One hopes that those 
responsible for school administrative policy at all 
levels have had the opportunity to give these pro- 
posals serious examination and are even now find- 
ing the means to implement the most feasible 
among them. 

Henry Borow 

University of Minnesota 


Comments on Current Books and the Passing Scene 


Mental health in colleges, mental hospitals as 
social organizations, the development of a sense 
of professional identity in physicians, womanpower, 
the goals of general education in behavioral terms, 
education and motivation, the careers of college 
graduates, industrial sociology, the casework re- 
lationship, these are the concerns of America’s 
psychologists today, judging by the literature 
which has come to this psychologist’s desk dur- 
ing recent months. A biased sample of the litera- 
ture, of course, and a biased sample of psycholo- 
gists too, for that matter! But relevant to and per- 
haps typical of counseling psychology’s interests. 

Mental Health in College and University, by 
Dana L. Farnsworth (Cambridge: Harvard Uni- 
versity Press, 1957), is a chattily written treatise 
based on Farnsworth’s substantial experience as 
university psychiatrist at MIT and now at Har- 
vard. It contains little that is new to readers who 
have worked as counselors on college campuses 
after receiving training in psychology or psychiatry 
and who have been inclined to think, not only 
of the students they see professionally, but also 
of the setting in which they and their student 
patients or clients live and work. But Farns- 
worth has been a thoughtful reviewer of his own 
experience, an active member of a GAP com- 
mittee on campus psychiatry, and he writes well. 
He is commendably modest about psychiatry’s 
tole (thanks partly to correspondence which our 


Editor initiated as Division 17 president and to 
Division 17 participation in a GAP committee 
meeting with Farnsworth); he has some useful 
ideas on counseling and discipline; and a chapter 
on counseling and psychotherapy contains some 
helpful thoughts on their relationships. 

Because of the Division 17 experience with 
Farnsworth’s GAP committee, in which the psy- 
chiatrists were somewhat shocked to discover that 
they had, in claiming responsibility for mental 
health on the campus, also claimed responsibility 
for many other student personnel services con- 
cerning which they had little knowledge and in 
which they had, on the whole, less interest, I 
was interested particularly in the material on 
responsibility and training for college mental 
health work. Farnsworth points out that there 
are only about 35 full-time college psychiatrists, 
and that there is no likelihood of the number 
increasing greatly. He is therefore realistically 
able to recognize the roles which counselors with 
other types of training will and must play. But 
he advocates finding other ways of enabling psy- 
chiatrists to make their special contribution: “Yet 
for the psychiatrist the stubborn fact remains that 
many students conflicts are so strong and so 
complicated that he believes that their manage- 
ment requires the knowledge and techniques of 
his profession.” Apparently he does not hold or 
has given up the position, held by some of his 
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colleagues, that serious disturbances in some stu- 
dents mean that all work with all students must 
be under psychiatric supervision. 

Seeking indications as to what Farnsworth con- 
siders to be the particularly pertinent “knowledge 
and techniques of his profession,” I found a quo- 
tation from Sol Ginsburg to the effect that a 
mental hygienist should be trained in psychology 
and psychoanalysis, sensitive to the problems of 
community relationships, and skilled in group 
techniques and in the techniques of mass com- 
munication. Elsewhere, he points out that the col- 
lege psychiatrist “is pleasantly surprised to ob- 
serve that evidences of psychopathology, which in 
other settings might be gravely disturbing, are 

. likely to represent transient phases of re- 
action to stress.” And a section on training for col- 
lege mental health work stresses obtaining an 
understanding of normal adolescents and young 
adults, and orientation to the educational setting. 
All of this reads more like counseling psychology 
than psychiatry to me, except for the occasional 
use of the job title “psychiatrist.” 

Under the heading of discipline, permissiveness 
combined with slow steady pressure toward the 
maintenance of high standards is advocated. It 
is easy to see that Farnsworth feels at home at 
Harvard, for his philosophy of discipline fits in 
well with local traditions. But his is not mere 
traditionalism, it is a well thought-out, mental 
hygiene, approach. 

Recognizing the difficulties in defining counsel- 
ing and psychotherapy in a way which differen- 
tiates them, Farnsworth defines a counseling at- 
titude which involves interest in and respect for 
the individual, compares teaching and counsel- 
ing, and then attempts to make the distinction. 
Teaching and counseling differ in that teaching is 
directed toward understanding subject matter, 
while counseling is directed toward the individual’s 
interaction with the new ideas to which he has 
been exposed. (The Editor immodestly thinks that 
he has a better defined distinction between teach- 
ing and counseling in the book edited by Hilton—- 
reviewed in this issue-——Ed.) Most counseling is 
therefore viewed as a function of educators, of 
teachers. Counselors can use their “understanding 
of therapeutic concepts without entering into 
psychotherapy,” establishing relationships whica 
have therapeutic implications, avoiding making 
interpretations of the unconscious meaning of 
behavior but dealing with the student as he is 
and helping him to make use of available re- 
sources. Psychotherapy is defined, in contrast, as 
a “special kind of interaction between patient 
and therapist in which the central frame of ref- 
erence concerns the removal or understanding of 
impediments to learning or to effective and satis- 
fying action . . . abnormality, not the normal 


situation, is in the foreground.” The discussion 
is phrased in a way which conveys the idea that 
a teacher may do counseling, but psychotherapy is 
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done by a “professional person, skilled in the 
dynamics of personality,” who might pr 

be a social worker or psychologist, but who 
emerges in the next paragraph, perhaps not to the 
exclusion of others, as a psychiatrist. 

Human Problems of a State Mental Hospital, 
by Ivan Belknap (New York: McGraw-Hill, 1956) 
appears now as a sort of quid pro quo: a psychia- 
trist having written about the college, a sociolo- 
gist writes about the mental hospital. In this 
case, too, the result is worth reading. Belknap’s 
book differs from Farnsworth’s in that it is the 
report of an investigation, conducted in one state 
institution by a team of sociologists. Using tra- 
ditional field study methods, a distinction is made 
between the official or formal and the unofficial 
or informal’ organization of the hospital. Three 
actual systems are identified: custodial, mainten- 
ance, and psychiatric-therapy. Because of problems 
of staffing, the custodial system becomes para- 
mount rather than the psychiatric-therapy system, 
To maintain order, attendants unofficially control 
the assignment of patients to wards and set up 
a status system among patients, functioning as 
foremen supervising working patients who do the 
actual ward work and who control non-working 
patients. Psychiatric staff members either fail to 
adjust to this fact and are sabotaged by the at- 
tendants who actually handle patients, or adjust 
to it by trying to treat patients within the frame- 
work of a system designed for custodial rather 
than for therapeutic purposes. And psychiatrists, 
psychologists, and others with professional inter- 
ests who take jobs in the hospital leave as soon 
as they can find more challenging employment, 
meet Board requirements, etc. As for patients— 
those who need treatment most do not get it, for 
attendants and working patients monopolize pro- 
fessional time and hospital resources as a r 
for good behavior. 

There is food for thought, and a program of 
action, in Belknap’s book. It, and other recent 
studies of this type such as Stanton and Schwartz 
Mental Hospital, should be required reading for 
all counseling psychologists working or consult- 
ing in mental hospitals, and for all students in 
this field who may have to do with mental hos- 
pitals. st 

The Student-Physician, by Robert K. Merton, 
George G. Reader, and Patricia L. Kendall (Cam- 
bridge: Harvard University Press, 1957), is a re- 
port of planning and studies conducted by Mert- 
ton and his associates at Columbia in the sociology 
of the professions, particularly medicine, It is an 
interesting and worthwhile report,. despite the fact 
that the authors get off to a bad start by sub- 
scribing to the Ivy League fallacy which has it 
that medical authors should always have the 
“M.D.” degree listed after their names, while 
gentleman-scholar authors should modestly hide, 
by omitting their Ph.D,’s, the fact that they, too, 
are educated. (The original liberal arts colleges 
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recognize the Ph.D. when someone has it.) Reader 
is the M.D., giving the study a medical blessing 
by his participation without insisting, apparently, 
that he be listed as senior author in order to 
show medical supervision. But of course, it is 
aly the insecure physician who feels threatened 
by other professions who takes such a stand, and 
this collection of studies is clearly the work of 
professionally mature persons. 

In these studies, the medical school is viewed 
as a social environment which transmits the pro- 
fessional culture of medicine by means of psycho- 
logical and social processes. Medical students 
learn to play the role of physician, conceiving of 
this role in ways which vary somewhat from one 
sudent to another. The authors seek an under- 
standing of how these occupational role concepts 
develop and how they, come to vary from one 
student to another, in studies of which these are 
the first in a projected series. Merton begins with 
a thoughtful paper on the sociology of medical 
education. He has a good historical perspective, 
makes a constructive distinction between psy- 
chology and sociology, points up the need to study 
the successive decisions which progressively com- 
mit an individual to a vocational choice and the 
support which the environment (medical school in 
this instance) gives or refuses to give to these 
decisions. He elaborates upon the importance of 
the resolution of occupational role conflicts in the 
development of a member of a profession. 

Rogoff has a good paper on the decision to 
study medicine, reporting the results of a question- 
naire study, after summarily dismissing studies of 
type and strength of motivation to make a deci- 
sion on the basis of the negative findings of in- 
adequately made studies. Following Lazarsfeld 
and Ginzberg, she focuses instead, and effectively, 
on the manner of deciding. There are good data 
on age of first interest and of actual decision, and 
she accepts (without giving credit) the distinction 
which counseling psychologists have recently made 
between preference and choice, with choice de- 
fined as an implemented decision. Early commit- 
ments are the most enthusiastic and complete, but 
most are made during the early college years 
when the premedical curriculum forces them. 
Contacts with physicians facilitate early decisions, 
but having a physician-father is more likely to 
delay decision making than to facilitate it (pre- 
sumably because of the need to develop a sense 
of one’s own identity). 

Thielens compares medical and law students, 
finding that the decision to become a lawyer is 
made later than that to become a physician. 
This is partly because of differences in curricu- 
lum-enforced decisions, partly because of less 
adequate role models and lower prestige in the 
legal profession. 

Among other studies, there is one by Hunting- 
ton on the development of professional self-image 
which describes the process by means of which 
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medical students develop concepts of themselves 
as physicians through various types of interactions 
with faculty members, classmates, nurses, and pa- 
tients. Students who felt that their patients as- 
signed them the role of physician rather than 
that of student were more likely than others to 
begin to think of themselves as physicians. 

Preferences for types of patients are studied by 
Martin, and training for uncertainty by Fox, in 
two more stimulating studies. The Cornell pro- 
gram of education in comprehensive medicine is 
described and studied, and some useful appendices 
follow. Future studies in this series will be watched 
with considerable interest by psychologists inter- 
ested in vocational development, in role theory, in 
self-concept formation, and in vocational counsel- 
ing. 

Time and space require briefer treatment of 
other books on hand, some of which deserve more 
extended comment (I may return to two or three 
of them in a later issue). In the meantime, once 
over lightly! 

Womanpower, by the National Manpower Coun- 
cil (New York: Columbia University Press, 1957), 
contains the type of policy statement usual in this 
council’s publications, and some important facts 
and stimulating discussion concerning the careers 
of women, woman’s role in the labor force, and 
the education of women. An important statement, 
by men, with women getting a word in edgewise 
(a good thing too, since women have been having 
so much to say about woman)! 


Behavioral Goals of General Education in High 
School, by Will French and Associates (New York: 
Russell Sage Foundation, 1957), contains brief 
statements concerning general education, and de- 
votes most of its pages to lists of behaviors, well 
classified, which are sought as outcomes of general 
education. Sponsored by the Russell Sage Founda- 
tion, the National Association of Secondary School 
Principals, and the Educational Testing Service, 
with assistance and cooperation from other organ- 
izations and persons, this is a valuable document 
because of its emphasis on concrete, behavioral, 
statements. Havighurst’s developmental task con- 
cepts have had an impact on this work, and in 
the vocational area the lists closely parallel those 
developed in my Career Pattern Study and thus 
give us a sort of validity by consensus. Despite one 
boner (the Kuder is an “ability test”), psychologists 
and educators in search of criteria will find this 
a useful source. 

Education and Human Motivation, by H. Harry 
Giles (New York: Philosophical Library, 1957), at- 
tempts to set forth an integrative theory of be- 
havior as a guide to work in human relations, has 
an appealing title, and 99 pages, the contents of 
which neither educated nor motivated me. 

College Graduates and Their Later Success, by 
Edward S. Jones (University of Buffalo Studies, 
1956, 22, No. 4), is a study of the predictive 
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value of academic, extracurricular, and psycho- 
logical test data, using criteria collected twenty 
years after graduation. A workmanlike study, with 
findings of significance for counselors. 


Industrial Sociology, by Eugene V. Schneider 
(New York: McGraw-Hill, 1957), may be com- 
pared to a text by the same title authored by D. C. 
Miller and W. H. Form: it is. much briefer (499 
vs. 858 pages), it has a clearer focus on social 
structure in industry, on labor unions as part of 
the structure, and on the interrelations of industry 
and community. It has good chapters on the role 
of the worker, but devotes much less attention to 
career patterns. Probably better for its specific 
purpose, it also has somewhat less of interest to 
a counselor. 
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The Casework Relationship, by Felix P. Big 
S.J. (Chicago: Loyola University Press, 1957 
the brevity and clarity of a primer; a 
Roman Catholic, flavor and orientation; 
contemporary understanding of the nature 
casework relationship. 


Obiter dictum: Farnsworth observes that, int 
“colleges which have modified the requiren 
to permit a certain number of absences { 
chapel) each semester, the impression may 
inadvertently be given that it is a privilege 
to go to college chapel instead of a privilege to 
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words used only when simpler ones would obviously be inadequate; (4) conformity to accepted tech- 
nical style in tables, terminology, and bibliography; (5) conclusions that are clearly related to the 
evidence presented. The reader should be led, step by step, from a statement of problem or pur- 
pose, through analysis of evidence, to conclusions and implications. 
| The style should conform to the instructions given in the Publication Manual of the American 
Psychological Association (Psychological Bulletin, 1952, 49, 389-449). A prospective contributor who 
es not have access to the manual may request the Toan of a copy from the Editor. It can be pur- 
chased for $1.00 from the Association Office, 1883 16th St., N.W., Washington, D.C. The author is 
mequested to study this manual before submitting his manuscript to avoid having an otherwise ac- 
ceptable manuscript returned for revision and retyping. Particular attention should be given to cor- 
rect style and completeness of tables and reference list. Two double-spaced typed copies of manu- 
script should be provided. 
' The date of receipt of the manuscript will be indicated on all articles published but the Editor 
teserves the right to delay an article occasionally in order to provide for a balanced issue. No arbi- 
itary limit is imposed upon length, but the most common expectation is between five and fifteen 
double-spaced typed pages. Those having brief research reports or proposed research should consider 
he advantages of using the “Research Notes” section for early and more informal publication. 
Each author will receive one hundred reprints of his article, gratis, but there is no current pro- 
vision for securing more than this number from the publisher. Arrangements can be made for a 
photographic reproduction of additional copies at low cost to the author. 
“Brief reports” of research of 750-800 words are invited for early publication, provided 100 copies 
of the complete report in dittoed or mimeographed form are stocked by the author for forwarding to 
readers upon request. A copy of the complete report and a copy of the brief report should 
be sent to the editor of the Research Notes from Here and There Department with second 
copies to the editor of the Journal. 


The Journal of Counseling Psychology, Incorporated, is published by a cor- 
poration established for this purpose. Over a period of time the stockhold- 
ers listed below have developed a concept of the Journal and have provided 
_ the capital necessary to launch the project. They are concerned with pro- 
' fessional development in the counseling field to the extent of risking per- 
sonal funds as well as providing management support. The editorial staff 
| wishes to acknowledge this substantial contribution by their professional col- 
~ leagues and collaborators. The names starred represent the elected directors 
of the corporation for the current year. 
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